-- Logs begin at Wed 2022-07-13 19:56:53 UTC, end at Wed 2022-07-13 21:00:03 UTC. -- Jul 13 20:27:56.968772 dv-cinder-849690-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 20:27:56.978015 dv-cinder-849690-1-smb devstack@keystone.service[80483]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 20:27:56 2022] *** Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: nodename: dv-cinder-849690-1-smb Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: machine: x86_64 Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: clock source: unix Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: pcre jit disabled Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: detected number of CPU cores: 4 Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: current working directory: / Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: detected binary path: /usr/bin/uwsgi-core Jul 13 20:27:56.980064 dv-cinder-849690-1-smb devstack@keystone.service[80483]: your processes number limit is 47680 Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: your memory page size is 4096 bytes Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: detected max file descriptor number: 2048 Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: lock engine: pthread robust mutexes Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: thunder lock: enabled Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 20:27:56.980772 dv-cinder-849690-1-smb devstack@keystone.service[80483]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 20:27:57.023921 dv-cinder-849690-1-smb devstack@keystone.service[80483]: Python main interpreter initialized at 0x5598563769c0 Jul 13 20:27:57.023921 dv-cinder-849690-1-smb devstack@keystone.service[80483]: python threads support enabled Jul 13 20:27:57.023921 dv-cinder-849690-1-smb devstack@keystone.service[80483]: your server socket listen backlog is limited to 100 connections Jul 13 20:27:57.023921 dv-cinder-849690-1-smb devstack@keystone.service[80483]: your mercy for graceful operations on workers is 90 seconds Jul 13 20:27:57.024274 dv-cinder-849690-1-smb devstack@keystone.service[80483]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 20:27:57.024342 dv-cinder-849690-1-smb devstack@keystone.service[80483]: *** Operational MODE: preforking *** Jul 13 20:27:57.024601 dv-cinder-849690-1-smb devstack@keystone.service[80483]: *** uWSGI is running in multiple interpreter mode *** Jul 13 20:27:57.024601 dv-cinder-849690-1-smb devstack@keystone.service[80483]: spawned uWSGI master process (pid: 80483) Jul 13 20:27:57.024812 dv-cinder-849690-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 13 20:27:57.025898 dv-cinder-849690-1-smb devstack@keystone.service[80483]: spawned uWSGI worker 1 (pid: 80494, cores: 1) Jul 13 20:27:57.025898 dv-cinder-849690-1-smb devstack@keystone.service[80483]: spawned uWSGI worker 2 (pid: 80495, cores: 1) Jul 13 20:27:57.025898 dv-cinder-849690-1-smb devstack@keystone.service[80483]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 20:28:02.353028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:28:02.353028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: from cryptography.utils import int_from_bytes Jul 13 20:28:02.353915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:28:02.353915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: from cryptography.utils import int_from_bytes Jul 13 20:28:02.358352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:28:02.358352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: from cryptography.utils import int_from_bytes Jul 13 20:28:02.358863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 20:28:02.358863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: from cryptography.utils import int_from_bytes Jul 13 20:28:02.401623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 20:28:02.401813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 20:28:02.401947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] command line args: [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 20:28:02.402246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 20:28:02.402393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ================================================================================ {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 20:28:02.402675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] admin_token = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.402907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] config_dir = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.403123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.403274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] config_source = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.403429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] debug = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.403658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.403983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.404184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.404428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.404668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.404894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_config_append = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_dir = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_file = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.405873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 20:28:02.405955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 20:28:02.406025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.406205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] command line args: [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 20:28:02.406292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.406409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 20:28:02.406482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.406586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ================================================================================ {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 20:28:02.406667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.406784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.406865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] admin_token = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] config_dir = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] config_source = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] debug = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.407971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.408927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_config_append = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_dir = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] publish_errors = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_file = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.409917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] standard_threads = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.410960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] use_journal = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] use_json = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] use_stderr = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.411982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] use_syslog = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.412695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.412781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.412947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.413035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.413175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.413403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.413483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.413655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] publish_errors = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.413747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.413893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.414081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.414170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.414353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.414671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.414768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.414848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.414935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.415060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.415184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.415302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.415423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.415530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.415662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] standard_threads = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.415771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.415898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.416144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.416323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.416552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] use_journal = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] use_json = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.416838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] use_stderr = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.416946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] use_syslog = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.417177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 20:28:02.417423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.417919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.418941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.419856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.420954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.421930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.422852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.423863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.424928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.425918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.426830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.427981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.428899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.429845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.430884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.431985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.432930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.433935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.434835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.435941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.external = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.436937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.password = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.437937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] auth.token = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.438999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.439932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.440857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.441970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.external = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.442996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.password = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] auth.token = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.443932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.444974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.445921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.446862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.447976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.448911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.449995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.450882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.451967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.452982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.453917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.454845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.455950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.456966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.457908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.458840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.459904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.460986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.461967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.462993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.463928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.464860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.465937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.466985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.467890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468528 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.468998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] role.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.469923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] role.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.470960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.471915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.472994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.473918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.474984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.475963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.476154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.476231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.476559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.476826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.476933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] role.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] role.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.477941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.478952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.479971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.480989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.481966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.482963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.connection = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.483964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.484886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.485972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.486894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 20:28:02.487452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.487934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.488170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.488402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.488648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.488893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.489122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.489369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.489661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.489921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.connection = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.490162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.490408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.490643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.490888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.491147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.491383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.491616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.492093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.492660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.492899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.493144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.493379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.493627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.493862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.494104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.494333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.494571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.494804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 20:28:02.495000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 20:28:02.517449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.517675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.517894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.520773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.521007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.521234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.526365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.530078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.554136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.554466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.557124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.557360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.698149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.702187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.750195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.750442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.750611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.750815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.814516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.814711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.814956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.815975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.816195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.816415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.840494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.840735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.840879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.840996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.841923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.842050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.842207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.853343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.854191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.866865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80494) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.867938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.868166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.868355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80495) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 20:28:02.885183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.885371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 20:28:02.885946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 20:28:02.886252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 20:28:02.886399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.886968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 20:28:02.887164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.887294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.887512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.887783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.888021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.898099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.898513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.898776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.899080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.899317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.899621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.899892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.900174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.907244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.908369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.910532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.910751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.911049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.911334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.911614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.911761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.911848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.911922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.912880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.913008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.913124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.913213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.913429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.913874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.914580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.914851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.939781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.941371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.941642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.941767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.943346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.943626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.946901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.947196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.947478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.949448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.949735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.950009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.954785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.955053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.957406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.957691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.959518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.959802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.960078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.960356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.960646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.960992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.961262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.961695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.962817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.963132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.963414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.963696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.963954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.964220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.964487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.964752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.980760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.981029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.985513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.988292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.988585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.989174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.989468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.993646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.994602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:02.997367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.997662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:02.998191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.001914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.002205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.002491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.002777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.002900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.003078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.003349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.006412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.010673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.010971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.011280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.011575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.011865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.012141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.022555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.022832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.023176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.023498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.031329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.031671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.031955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.032220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.032497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.033019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.033287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.036449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.036727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.037008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.037284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.037559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.040912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.042615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.042886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.046080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.046361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.046646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.046957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.047231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.050645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.050956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.051233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.051503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.051791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.052063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.052346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.065829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.066111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.066405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.066691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.066993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.067279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.067559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.071530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.074776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.078052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.079735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.081477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.081752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.082033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.087925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.089386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.091068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.091193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.094272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.094478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.094594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.094825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.095129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.096083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.097830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.098122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.098406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.104568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.104841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.105117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.106447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.108104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.111308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.111600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.111888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.112164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.112901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80494) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.113181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.113455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.113728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.113993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.114262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.114508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.114774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.115168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.115436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.115714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.115976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.116242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.116513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80494) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.124537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.124826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.125103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.133537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80495) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 20:28:03.133827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.134107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.134372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.134645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.134939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.135218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.135496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.135870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.136139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.136405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.136664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.136930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.137191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80495) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 20:28:03.153922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598563769c0 pid: 80494 (default app) Jul 13 20:28:03.157345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ef9-3c06-4dbb-b89a-650b45006e69 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:03.157634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ef9-3c06-4dbb-b89a-650b45006e69 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:03.157909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ef9-3c06-4dbb-b89a-650b45006e69 None None] PATH_INFO: `/v3` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:03.162224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Jul 13 20:28:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:03.175525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598563769c0 pid: 80495 (default app) Jul 13 20:28:10.750957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:10.751822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:10.751822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:10.754031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:10.764389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:10.764983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:10.765074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:10.838942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: INFO dbcounter [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] Registered counter for database keystone Jul 13 20:28:10.863644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG oslo_db.sqlalchemy.engines [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:28:10.873145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writer thread running {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:28:11.062066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG passlib.handlers.bcrypt [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80495) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 20:28:11.062485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG passlib.handlers.bcrypt [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80495) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 20:28:11.118877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:11.120529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:11.269187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 13 20:28:11.365049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:11.442728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: INFO dbcounter [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] Registered counter for database keystone Jul 13 20:28:11.464524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG oslo_db.sqlalchemy.engines [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 20:28:11.476296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writer thread running {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 20:28:11.596700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9861-7d1f-4f70-bc7e-e5bc657887e5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:11.602459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:11.603271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:11.603644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:11.604008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:11.612722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:11.663615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 20:28:11.663989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79a2d4-5635-4f88-9a48-e38434619dab admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:11.675026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jul 13 20:28:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:28:11.683020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:11.697848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572593-242f-44ee-8ce0-2e8662b2e356 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:11.703668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:11.704783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:11.705065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:11.705348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] PATH_INFO: `/v3/projects/1b2e1869a6a84cb5949adf32c69b433a` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:11.709505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1b2e1869a6a84cb5949adf32c69b433a)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:11.759252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING keystone.common.rbac_enforcer.enforcer [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 20:28:11.759589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aa6c5-86ee-4fa4-88c1-aaec7c6476b0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:11.764313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Jul 13 20:28:11 2022] GET /identity/v3/projects/1b2e1869a6a84cb5949adf32c69b433a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:13.740391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe3c2-9d36-41a0-90e5-adfd243868b3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:13.741180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe3c2-9d36-41a0-90e5-adfd243868b3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:13.741311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe3c2-9d36-41a0-90e5-adfd243868b3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:13.748919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:13.755657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:13.756078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:13.756261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:13.776890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:13.778426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:13.787034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 20:28:13.822641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe3c2-9d36-41a0-90e5-adfd243868b3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:13.838439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe3c2-9d36-41a0-90e5-adfd243868b3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:13.843801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:13.844437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:13.844724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:13.844994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:13.854282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:13.856109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b856a-8bf4-4c73-9a01-4505efedecd2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:13.865048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jul 13 20:28:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:28:13.871988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:13.885408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493e43-cd43-4769-a33a-839982b6d89f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:13.890356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:13.891246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:13.891532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:13.891808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:13.893260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:13.895131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47571-6609-4edb-b4fc-755000883646 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:13.896705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Jul 13 20:28:13 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:15.979911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042c723-b63d-4204-aa43-e2c7a1d88d73 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:15.980465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042c723-b63d-4204-aa43-e2c7a1d88d73 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:15.980465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042c723-b63d-4204-aa43-e2c7a1d88d73 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:15.981817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:15.987082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:15.987508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:15.987650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:15.994215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ffc-0c03-4dfc-bb7d-966d3d4e7cad None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:15.994627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ffc-0c03-4dfc-bb7d-966d3d4e7cad None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:15.994960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9ffc-0c03-4dfc-bb7d-966d3d4e7cad None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:15.996534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:16.003867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.004159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.004420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.008809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:16.010010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:16.044101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG passlib.handlers.bcrypt [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80494) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 20:28:16.044514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG passlib.handlers.bcrypt [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80494) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 20:28:16.089447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:16.091074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:16.093253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:16.116095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.140857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.189466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:16.211703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.222459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cd1a-a12b-4f0b-a786-dac251035b88 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.257570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.258580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.258861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.259165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.270554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:16.281705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:16.282593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:16.283455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:16.288991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.319316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719a50-afd2-4103-83ea-eb7d724bcf5a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.321679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.358426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.359357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.359642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.359931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.373264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.393531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080edfe-3a9e-433a-b370-352fb9db6d57 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.429408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.430842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.431135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.431585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.431874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.432156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.432911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:16.433217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.434609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.446973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 7/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:16.452621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.529032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 20:28:16.534793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.537687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.556531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564287a-0129-432a-8cfe-7b061198c03c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.588863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.589737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.590010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.590282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.591547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.593018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.594623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:16.600480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.616094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.635814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266d10a-2293-4d52-a5c5-d327fc0f2a9b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.672292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.673097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.673384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.673660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.692353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.693801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.702542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53d55-579f-4327-a05a-4b139a922fbb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:28:16.714665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:16.715492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:16.716275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:28:16.716275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:28:16.716275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:28:16.716275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:16.716275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:16.722644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.738554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.739397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.739685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.739960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.741147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.742885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.744523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:16.750212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:16.779969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.825493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4318e-b2d9-463b-9001-8ef4a5dc966a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.829844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:16.849476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2178-0e9c-462c-ae9b-219fc7eddd4c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:16.863915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.864582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.864871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.865151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.865895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:16.866205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.867684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412739a2-f0f1-4584-aecc-38e86cc67d98 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.884500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:16.884885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:16.885153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:16.885442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:16.885719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:16.886637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.domain.id=default, user.id=09add49e7af745969dc73cde82e7f5b7) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:16.886971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:16.888451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd4946-6fe3-46cf-ad17-9a9a63efe207 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:16.896013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jul 13 20:28:16 2022] GET /identity/v3/role_assignments?user.id=09add49e7af745969dc73cde82e7f5b7&scope.domain.id=default&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:19.163108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e76-95c8-489d-998b-dc9554e6d231 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.163657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e76-95c8-489d-998b-dc9554e6d231 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.163657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45e76-95c8-489d-998b-dc9554e6d231 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.165650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:19.170968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b0255-1e75-4b30-86d7-20b8e1e6deaa None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.171379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b0255-1e75-4b30-86d7-20b8e1e6deaa None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.171574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b0255-1e75-4b30-86d7-20b8e1e6deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.193114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-475b0255-1e75-4b30-86d7-20b8e1e6deaa None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:19.194333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-475b0255-1e75-4b30-86d7-20b8e1e6deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:19.277738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:19.292146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172632f-e47e-4f41-8d0a-5f6e754334e2 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.292537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172632f-e47e-4f41-8d0a-5f6e754334e2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.292880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172632f-e47e-4f41-8d0a-5f6e754334e2 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.294622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:19.300780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d294e-2d42-4ca2-b964-46fe07359fe9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.301168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d294e-2d42-4ca2-b964-46fe07359fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.301479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d294e-2d42-4ca2-b964-46fe07359fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.312942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172632f-e47e-4f41-8d0a-5f6e754334e2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:19.350795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-fd6d294e-2d42-4ca2-b964-46fe07359fe9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:19.352075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fd6d294e-2d42-4ca2-b964-46fe07359fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:19.457988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 12/25] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:19.476467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85d0d-2a2f-4c26-b11f-5f83c002241d None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.476788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85d0d-2a2f-4c26-b11f-5f83c002241d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.477028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e85d0d-2a2f-4c26-b11f-5f83c002241d None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.478543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 13/26] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:19.483629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.483918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.484602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.507284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:19.513913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:19.515205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:19.587701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172632f-e47e-4f41-8d0a-5f6e754334e2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:19.623215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:19.642233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:19.643105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:19.666056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:19.666873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.667183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.667462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.691671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:19.701331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:19.702181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:19.702937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:19.720598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:19.721463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:19.812700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f1aed-3e03-49cf-980e-91416d26e9e3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:19.851028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:19.851773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.852076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.852496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.853945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:19.855653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43e595-ebb2-421f-ac29-9c0033b25c10 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:19.856172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d208-00fe-4863-a481-b4ea238fab00 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:19.858542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:19.897212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:19.899377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:19.899855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:19.900345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:19.911640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:19.913678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:28:19.933279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:19.934115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:19.934945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:28:19.934945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:28:19.934945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:28:19.934945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:19.936943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:19.937900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:19.970939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:20.016276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 15/30] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 13 20:28:19 2022] POST /identity/v3/roles => generated 219 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:20.018071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b324a-a35b-4fec-be11-ab30b7f8d05d None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.018576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b324a-a35b-4fec-be11-ab30b7f8d05d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.019104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b324a-a35b-4fec-be11-ab30b7f8d05d None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.020926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 16/31] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:20.021967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b324a-a35b-4fec-be11-ab30b7f8d05d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.053832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4dc0f-e247-4238-a13e-73d7b248786b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.115785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.116947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.117602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.118068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.119154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:20.119658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.121304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596da5f-f0e0-472d-8b92-964d67769d0b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.138023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 16/32] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:20.139726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.140211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.140675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.158938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:20.160496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:20.233996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b324a-a35b-4fec-be11-ab30b7f8d05d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.266197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 17/33] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:20.267813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.280102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.280754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.281048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.281332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.282531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:20.282862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.284783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.295427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:20.311243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 17/34] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:20.315002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.385741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:20.401352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bacc44-f775-49ba-8ab0-4fcf053ad863 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.438135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604311a-626d-486a-b2dd-432dcfc0d3ab None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.444965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.446015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.446309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.446637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.448957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.450890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.453450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 18/35] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:20 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:20.454370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.479495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.480570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.481048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.481514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.482475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.484317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.503341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 18/36] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 13 20:28:20 2022] POST /identity/v3/roles => generated 225 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:20.504592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.570376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:20.585541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6877-4a30-45c1-89a7-e4c8f9971c16 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.626696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198db37-4702-4230-be11-d02e6440816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.627450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198db37-4702-4230-be11-d02e6440816f None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.627740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198db37-4702-4230-be11-d02e6440816f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.628020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198db37-4702-4230-be11-d02e6440816f None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.628750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198db37-4702-4230-be11-d02e6440816f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.630222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198db37-4702-4230-be11-d02e6440816f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.785671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72120-d483-41df-ab89-ce596fbc7b1a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:20.801243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:20.821361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:28:20 2022] POST /identity/v3/projects => generated 301 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:20.834668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3889-7da7-4c9e-9465-b980c7744d9d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.835261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3889-7da7-4c9e-9465-b980c7744d9d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.835631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3889-7da7-4c9e-9465-b980c7744d9d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.837373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 20/38] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:20.840685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:20.841872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.842164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.842447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.843190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2832e5-e10d-4204-bd83-a242d6adb09e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.843454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2832e5-e10d-4204-bd83-a242d6adb09e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.843735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2832e5-e10d-4204-bd83-a242d6adb09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.843827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:20.845329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:20.847317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 19/39] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:20.854837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:20.866522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-df2832e5-e10d-4204-bd83-a242d6adb09e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:20.868334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-df2832e5-e10d-4204-bd83-a242d6adb09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:20.962983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:20.970993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754dc75-4564-466f-ad64-b4b11f19dce6 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.971292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754dc75-4564-466f-ad64-b4b11f19dce6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.971575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754dc75-4564-466f-ad64-b4b11f19dce6 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.973155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:20.979357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:20.979656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:20.979941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:20.999832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:21.001087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:21.007052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3bc7-c294-46fd-a26f-c0419943b895 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:21.053896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469153c-775d-4297-9183-abbb49928529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:21.054762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469153c-775d-4297-9183-abbb49928529 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:21.055104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469153c-775d-4297-9183-abbb49928529 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:21.055382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469153c-775d-4297-9183-abbb49928529 None admin] PATH_INFO: `/v3/domains/default/users/09add49e7af745969dc73cde82e7f5b7/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:21.057457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469153c-775d-4297-9183-abbb49928529 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=09add49e7af745969dc73cde82e7f5b7, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:21.058971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469153c-775d-4297-9183-abbb49928529 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:21.072147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:21.076153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Jul 13 20:28:20 2022] PUT /identity/v3/domains/default/users/09add49e7af745969dc73cde82e7f5b7/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:21.076971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469153c-775d-4297-9183-abbb49928529 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:21.087396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:21.112096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:21.134875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:21.202930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469153c-775d-4297-9183-abbb49928529 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:21.238162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae183ff-7157-48e1-92a0-97447b1f372b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:21.243070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:21.243725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:21.244009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:21.244285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:21.245047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:21.246452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:21.268355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 13 20:28:21 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:21.276488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:21.277302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:21.277587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:21.277864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:21.279678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:21.282737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14bab7-e5e0-4944-a71a-2eee86574fa6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:21.286011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:21.292231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:21.408551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c0c1a-a48a-4f7d-9cc9-fe6249507761 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:21.410188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:21.453220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:21.453220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:21.453220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:21.453220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:21.453605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:21.454243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba44a1-7edb-453d-89a6-67ddc3f5a85d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:21.482982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:28:21 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:23.085552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e704b4-e722-467f-b8ca-137a08d0cfc6 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.086074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e704b4-e722-467f-b8ca-137a08d0cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.086316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e704b4-e722-467f-b8ca-137a08d0cfc6 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.087770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:23.093216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.093620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.093792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.112469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:23.114034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:23.186051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:23.208699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e704b4-e722-467f-b8ca-137a08d0cfc6 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.384350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:23.420031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e704b4-e722-467f-b8ca-137a08d0cfc6 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.454522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.455340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.455625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.455898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.466587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-591c7043-fc69-4f56-a89c-38b845196ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:23.474364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:23.475698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:23.476750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:23.483576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.504636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c4ef-754c-4716-9b12-407e150c2090 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.504921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c4ef-754c-4716-9b12-407e150c2090 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.505175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c4ef-754c-4716-9b12-407e150c2090 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.507124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 27/50] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:23.512215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.512514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.512793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.529853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:23.531108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:23.569275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:23.585529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dc258-0057-46fa-b16f-ee479cee7a86 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.602009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 28/51] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:23.620347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.621024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.621316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.621602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.622354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:23.622668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:23.624127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:23.624616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.634641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 24/52] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:23.640101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.687060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:23.728054 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4b623-2bd3-4756-94b4-ff9057456682 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.748049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338604-e20b-439b-af3d-cef8e0120cb9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.762248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.763077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.763363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.763629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.764841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:23.766312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:23.767961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:23.773721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.782537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.783453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.783742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.784016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.785271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:23.786789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:23.788477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:23.794117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:23.809827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:23.874227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7d769-410e-48b7-b526-4f7bce617b34 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.894151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd43e9-5ee2-48d8-a039-c2e7f6028524 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:23.899087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:23.908785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.909456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.909744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.910025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.910741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:23.912250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237616e-31f8-4001-8b50-d5f8c62e211b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:23.928101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:23.928904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:23.929254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:23.929568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:23.930820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:23.932356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:23.934012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:23.937550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 30/56] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jul 13 20:28:23 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:28:23.949427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:24.032681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:24.053187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d3b29-6d12-4721-b8a9-13a4c7159bec None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:24.089947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:24.090621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:24.090887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:24.091207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:24.092060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.domain.id=default, user.id=09add49e7af745969dc73cde82e7f5b7) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:24.092374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:24.093863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06441fe9-9bc9-4490-9740-5561b1edf45d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:24.100533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 27/57] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jul 13 20:28:23 2022] GET /identity/v3/role_assignments?user.id=09add49e7af745969dc73cde82e7f5b7&scope.domain.id=default&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:25.943830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7e0-9277-4144-b254-6f68d42f2f21 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:25.944350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7e0-9277-4144-b254-6f68d42f2f21 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:25.944350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7e0-9277-4144-b254-6f68d42f2f21 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:25.945858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:25.952136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:25.952813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:25.953083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:25.976292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:25.977340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:26.049939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:26.088383 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139d7e0-9277-4144-b254-6f68d42f2f21 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:26.201644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139d7e0-9277-4144-b254-6f68d42f2f21 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:26.236400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:26.237186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:26.237472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:26.237748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:26.238985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:26.240476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f143-572d-4355-b501-fea0f65e0670 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:26.242144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:26.248451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:26.345928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:26.369053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8aae5-b01f-4b34-a693-d68040fc43e1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:26.404376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:26.405044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:26.405334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:26.405605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:26.406314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:26.407806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7299e-eeef-42f0-aee9-d82f2b924948 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:26.436939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:26 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:29.429823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c2c0-d356-489d-9893-b72a1b8a4524 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.430668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c2c0-d356-489d-9893-b72a1b8a4524 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.431156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7c2c0-d356-489d-9893-b72a1b8a4524 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.432696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:29.438055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.438855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.439336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.468140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:29.469667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:29.561457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297481d1-9741-4230-9d10-67eea7ada5ff None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.562017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297481d1-9741-4230-9d10-67eea7ada5ff None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.562465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297481d1-9741-4230-9d10-67eea7ada5ff None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.564090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 34/63] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:29.568855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 30/64] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:29.569198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.569745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.570341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.587273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:29.588750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:29.607365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:29.654680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:29.703605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:29.719325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:29.759603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:29.790355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc179be1-dc7d-430a-aebc-1d4c3818edd2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:29.840115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:29.840929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.841222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.841505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.852557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-5ab94c1a-86af-4d92-863a-aa5ee439347a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:29.860208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:29.861276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:29.862290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:29.864329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 31/66] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:29.865711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60e46-a730-4eed-82bc-e95c68c758e2 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.866223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60e46-a730-4eed-82bc-e95c68c758e2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.866643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a60e46-a730-4eed-82bc-e95c68c758e2 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.868350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 32/67] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:29.870631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60e46-a730-4eed-82bc-e95c68c758e2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:29.893617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69aee0-a254-4bd3-bdaa-4ba56da3a5b7 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:29.929191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:29.930255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.930673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.931102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.941837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-96e941ba-7514-41bf-a448-658372cdd2fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:29.949784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:29.950800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:29.951634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:29.957144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 36/68] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:29.957144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:29.957144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:29.957144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:29.973899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:29.975753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:29.981206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a60e46-a730-4eed-82bc-e95c68c758e2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.006417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.007527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.019996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.020791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.021152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.021507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.022778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:30.023358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.025230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.035841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 33/69] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:30.040891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.054977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 37/70] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:30.061103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.150684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a05a2-7723-4f8b-9981-8351e992d6c1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.180001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf469-1fd6-4758-8530-ae411b1c4c2c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.188078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.188548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.188840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.189121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.189871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:30.190341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.191706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144817a-3749-41ac-ba6f-2d68c6f571c3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 34/71] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d6a-68d8-4163-826f-0c47f480d568 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d6a-68d8-4163-826f-0c47f480d568 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce8d6a-68d8-4163-826f-0c47f480d568 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 35/72] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:30.205554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8d6a-68d8-4163-826f-0c47f480d568 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.223242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.224167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.224462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.224744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.226470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.227977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.233879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 38/73] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:30.233879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.266635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.267729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.327136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce8d6a-68d8-4163-826f-0c47f480d568 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.336195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af73eb-b94b-48b7-9ad4-ffe2c40c0280 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.361694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.362512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.362799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.363113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.372018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.372906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.373194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.373475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.373579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-27fcfff2-acab-440e-b319-6128f0e1026e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:30.381560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:30.382545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:30.388419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.389117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.389117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.396635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.398197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.400153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 39/75] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:30.400930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.403656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:30.404901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:30.474141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:30.474860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.495775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.508941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b02f3-be4c-4a01-b54f-0c72fad62a98 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.520793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.543291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.543946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.544238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.544518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.586906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4fa6e-611b-4997-9d74-10825eebc0d2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.612800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.614525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0ce0-17d3-4fd2-b868-320f84ce41ab None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.620307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.620975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.621261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.621549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.622295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:30.622599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.624024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.632151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:30.635510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.703854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.714907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:30.716602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956557-3e49-423c-9443-3e5818f08aa0 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.716894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956557-3e49-423c-9443-3e5818f08aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.717174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a956557-3e49-423c-9443-3e5818f08aa0 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.718889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 41/79] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:30.719534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a956557-3e49-423c-9443-3e5818f08aa0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.737305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.741106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b403c1-91ee-41de-82c1-1875d1c65e0d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.775566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.776214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.776498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.776773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.821045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a956557-3e49-423c-9443-3e5818f08aa0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:30.845077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:30.846588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:30.855192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:30.856055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:30.856407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:30.856717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:30.867334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:30.874953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:30.875880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:30.876660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:30.877294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.931238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.946395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:30.951224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 39/81] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:30.952318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:30.980406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8bca-6979-4447-857c-f5c8f330987c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.013205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.014012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.014301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.014581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.015831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.017468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfa324-552d-4ec5-b8d5-f721d6cd3453 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.020654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.020654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.020654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.020927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.038388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:31.039927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:31.059826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aec32-4c7a-4867-815b-efd05162f49a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.100841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.102325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.102616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.102894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.104132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.105601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.107353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 40/83] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:30 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.116110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 44/84] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:31.116254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.116335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.163711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.177889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.212884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f1522-4533-4982-85c6-02f36a7b1bcc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.214149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f00e7-c418-4f1a-af2d-2a5c3f924004 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.246121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.246786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.247102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.247381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.247903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.248125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:31.248431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.248772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.249056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.249333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.249820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.250529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.252015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.253723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 45/85] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.254480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.266676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 41/86] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.266676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.353684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d99a8-d9b0-47a3-8c89-43736ea01b74 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.366233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5975192-a078-4e22-9870-dbfa5c0fd74d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.371363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.388937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.389586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.389870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.390148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.392241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.402278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.402937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.403249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.403524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.404402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=09add49e7af745969dc73cde82e7f5b7) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:31.404717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.406202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.411981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 42/87] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/role_assignments?user.id=09add49e7af745969dc73cde82e7f5b7&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.412743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.467362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.468897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.531126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9b913-7ab5-4d65-a991-44c1ec8f9405 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.568315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.569121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.569414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.569691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.571320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.572825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.574514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 43/88] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.575344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.578554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 46/89] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:31.579507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.597834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.645268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.691297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e7275-5b1b-428e-932d-342f5ab3af60 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.694251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c532ee2-de18-4eba-898b-d1fe6e395da9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.727809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.728702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.728992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.729273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.730509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.732021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.733673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.735049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.740923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.741598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.741908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.742204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.743080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:31.743387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.744965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.758953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.758953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.846593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.865064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b110e54-ab30-47df-9306-f6e60ee9b8ca None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.884826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054c15-8dc9-4af8-acbe-f7b11d05163a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:31.910777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.911809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.912101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.912388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.913413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.914377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:31.916892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.927840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:31.929276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:31.929276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:31.929453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:31.930948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:31.932501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:31.934478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:31.940153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:31.950495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 48/93] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:31 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:31.951482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:32.116763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ec9ba-4488-4832-a632-78a8aa1bb31a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:32.152578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:32.153433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:32.153821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:32.154175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:32.159375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383040-62e4-42fb-8941-11765f14d71b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:32.195979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:32.197014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:32.197629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:32.198078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:32.199224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:32.199743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:32.201415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:32.211227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 49/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:32.217796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:32.230151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:32.231709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:32.347833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 46/95] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:32.353963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:32.367521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:32.466056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfcec-eadb-4d7d-8a2c-97d6b0a7bf62 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:32.502648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:32.503560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:32.503849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:32.504130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] PATH_INFO: `/v3/projects/4174e0abae56437091b34192ee345cf1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:32.505449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] RBAC: Authorizing `identity:get_project(project_id=4174e0abae56437091b34192ee345cf1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:32.506947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a1948-e113-4f18-8b09-4a1c1faa93a1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:32.509022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:32 2022] GET /identity/v3/projects/4174e0abae56437091b34192ee345cf1 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:32.514680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:32.613714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:32.623904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6434-38fe-4d19-877f-7a8346036f49 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:32.665706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:32.666391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:32.666684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:32.667000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:32.667857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=4174e0abae56437091b34192ee345cf1, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:32.668176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:32.669648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaa58d-ccb6-4de4-93aa-0c3f7295c713 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:32.677704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:32 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=4174e0abae56437091b34192ee345cf1&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:33.711945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c025962-8891-4b8f-9ece-37344ad66892 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:33.712894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c025962-8891-4b8f-9ece-37344ad66892 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:33.713359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c025962-8891-4b8f-9ece-37344ad66892 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:33.715237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:33.720192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:33.720964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:33.721450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:33.751922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:33.753487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:33.838391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:33.872194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c025962-8891-4b8f-9ece-37344ad66892 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:33.973749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:34.008292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c025962-8891-4b8f-9ece-37344ad66892 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:34.048659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:34.049821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.050308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.050787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.061611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:34.069509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:34.070438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:34.071185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:34.073574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:34.079494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:34.204495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:34.220042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dde39-55f7-41b6-a6fd-700fbd524633 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:34.269551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:34.270146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.270433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.270713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.271499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:34.271808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:34.273261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f0cff-1670-4012-816e-4feb51420d6e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:34.286892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 49/101] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:34.292123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:34.369307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352937a6-0b48-45c6-a7bc-4e6ab3e10a8f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.369621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352937a6-0b48-45c6-a7bc-4e6ab3e10a8f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.369876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352937a6-0b48-45c6-a7bc-4e6ab3e10a8f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.371550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 50/102] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:34.378936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.378936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.378936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.411569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:34.412761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:34.468077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90469819-7c8f-43e7-bcab-26a94e848d28 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:34.542794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:34.544044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.547164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.547669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.549188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:34.551563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:34.554456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 53/103] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:34 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:34.561216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:34.569722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:34.571401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 51/104] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:34.608714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:34.781245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:34.783982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44de0a7-3534-4f29-ba49-7b590e005406 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:34.816723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df954-7331-4e51-9582-21cc2b28889d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:34.865976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:34.866855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.867158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.867433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.868647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:34.870113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:34.872331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 54/105] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:34 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:34.878669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:34.899438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:34.900250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:34.900534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:34.900810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:34.923370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:34.939002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:34.939873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:34.941062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 52/106] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:34.948539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.003416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:35.049557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830ce9-a615-4c47-8587-58c962ad1a73 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.089364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.090185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.090465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.090739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/09add49e7af745969dc73cde82e7f5b7/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.092756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, user_id=09add49e7af745969dc73cde82e7f5b7, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.094344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40759b9e-7ddf-4202-83d9-698351fce537 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.110708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:34 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/09add49e7af745969dc73cde82e7f5b7/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:28:35.113217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa133dd-0e17-462c-a0f1-435ab346fe1c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.113678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa133dd-0e17-462c-a0f1-435ab346fe1c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.113966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa133dd-0e17-462c-a0f1-435ab346fe1c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.115619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 56/108] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:35.121821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.122114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.122374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.140141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:35.141369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:35.194615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c0c3-0d9c-4043-aeb4-660bf1a180e0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.271920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.272853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.273252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.273532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.274947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:35.275961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.277376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.283889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 57/109] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:35.290722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:35.305523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 53/110] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:35.310835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.314005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.376374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:35.433029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c104f4-4f3e-46ee-8906-cd4d25c4a4b1 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.485290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.486179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.486462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.486734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.488978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.490445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc85fe-04df-4b0b-aa51-2b7cabe7df79 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.492176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:35 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:35.493379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fb58-9d9f-430a-99ed-50ddc95e889c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.493633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fb58-9d9f-430a-99ed-50ddc95e889c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.493912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fb58-9d9f-430a-99ed-50ddc95e889c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.496460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 59/112] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:35.497330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429165b8-4bcf-4eb6-bdc7-dee9ad73b18f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.498010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fb58-9d9f-430a-99ed-50ddc95e889c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.550144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.550669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.551124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.551708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.564886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b44e307c-5fb3-4a3c-afa0-816bbe410e06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:35.573348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:35.574426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:35.575379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:35.577072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 54/113] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:35.578357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.578744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.579286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.597025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:35.598449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:35.636592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fb58-9d9f-430a-99ed-50ddc95e889c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.669492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:35.677278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:35.686966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 55/114] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:35.686966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.695177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.696354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.697361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.697868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.700072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.702562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66799c6c-0545-407f-85ff-8055c4137dcb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.709382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 60/115] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:35 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:35.709382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec2d1-5fa1-48d0-9ac6-0838c85587fb None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.709382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec2d1-5fa1-48d0-9ac6-0838c85587fb None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.709382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec2d1-5fa1-48d0-9ac6-0838c85587fb None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.713771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 61/116] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:35.713997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec2d1-5fa1-48d0-9ac6-0838c85587fb None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.818572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3114d0-4f8b-4fe3-9a89-b7e04e5c4ce8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.837970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec2d1-5fa1-48d0-9ac6-0838c85587fb None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:35.864261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.864933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.865219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.865496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.866251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:35.866556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.868049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db8e8-2e0a-4727-9534-c9b6862861cd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.876878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 56/117] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:35.877859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.878144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.878414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.887389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:35.888613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:35.889102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:35.889581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/8e28e32fa9374a028b56752cdb237ff9/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:35.892678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, user_id=8e28e32fa9374a028b56752cdb237ff9, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:35.894375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:35.895975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:35.897208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:35.914305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 62/118] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:35 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/8e28e32fa9374a028b56752cdb237ff9/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:35.916334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:35.958531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.011012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 57/119] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:36.012034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.028616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.089105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef20da-6281-46d8-bc46-32b2debb6db6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.134791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.135661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.135950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.136229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.149590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:36.159476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:36.160367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:36.161653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 63/120] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:36.162464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.188680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ac9b-f9a2-4928-94f8-c3456f8b2123 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.228912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.229817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.230105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.230385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.231628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.233180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66af8-d729-46fb-9812-997d90ca752f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.234930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 58/121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.236152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829b79-a31f-44dd-9aa7-a44e32e3f9ba None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.236548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829b79-a31f-44dd-9aa7-a44e32e3f9ba None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.236861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829b79-a31f-44dd-9aa7-a44e32e3f9ba None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.242099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 59/122] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:36.242099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829b79-a31f-44dd-9aa7-a44e32e3f9ba None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.299183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.303201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49935f-e32f-425f-8f1e-dc9be92a6ca5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.326093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.354304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.355688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.355882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829b79-a31f-44dd-9aa7-a44e32e3f9ba None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.356371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.356873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.375277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:36.386979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:36.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:36.388612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:36.391163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:36.392102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.399215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.400058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.400393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.400770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.401625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:36.402030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.403567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01568f3-75c2-4465-8115-308f3e362386 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.412720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.413949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.414304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.414650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.435809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:36.437103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:36.522937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:36.522937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.536183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b99763-5c59-44fb-b152-04a42ca4ea11 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.578267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.579039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.579324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.579601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.580798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.582257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.584354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 65/126] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.585145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.590041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.653098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.660756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c9aa-f81d-46b6-a77c-a1bedde4e5a3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.705414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.706586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.707123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.707646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.708631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:36.709134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.710975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.720816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 62/127] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.721986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.730530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adc573-1cdb-4414-8d83-7ad2e6db1b0f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.766388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.767297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.767587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.767866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] PATH_INFO: `/v3/users/7a547613dc594c2aa92e660ef8d9246a` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.781707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] RBAC: Authorizing `identity:get_user(user_id=7a547613dc594c2aa92e660ef8d9246a)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.783236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.785171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 66/128] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/users/7a547613dc594c2aa92e660ef8d9246a => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.785662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.837935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc328d5-e6b6-4f89-9e93-ccf4856a4002 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.841303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.876783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.878117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.878654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.879173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.880636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.882501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.889428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ae94-3a22-4688-8ef5-05c8ba01ca22 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:36.890246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:36.890471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 63/129] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:36.892353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:36.924418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:36.925243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:36.925791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:36.925791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/8e28e32fa9374a028b56752cdb237ff9/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:36.928119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, user_id=8e28e32fa9374a028b56752cdb237ff9, role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:36.930300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:36.951376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 67/130] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:36 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/8e28e32fa9374a028b56752cdb237ff9/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:36.952603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.036304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963ef27-bd63-42a0-9773-50d15d7d2647 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.076461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681487-da17-4378-bc88-cf1cec076185 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.083295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.084519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.084813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.085097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.088225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.089774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.091743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 64/131] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:37.092330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.139366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.140028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.140326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.140604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.163360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:37.182840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:37.236523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.238653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.242397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd8dc8-4aca-4b80-b560-4cc149d9c76d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.283787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.284605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.285641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.286031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.286860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.289510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.323152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 65/132] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:28:37 2022] POST /identity/v3/projects => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:37.324051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.438106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:37.450205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262436c-1130-4248-92b4-dc0538bb210e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.466463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:37.472069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.497338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.498236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.498529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.498814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] PATH_INFO: `/v3/projects/4174e0abae56437091b34192ee345cf1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.502708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] RBAC: Authorizing `identity:get_project(project_id=4174e0abae56437091b34192ee345cf1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.505385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.512661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 66/134] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:37 2022] GET /identity/v3/projects/4174e0abae56437091b34192ee345cf1 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:37.518190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.561398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:37.610374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df573-f512-4336-a2bb-7dcd25d9fc8a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.653058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.653943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.654233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.655912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.656700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.658187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.660313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 69/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:37 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:37.669506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:37.758569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b41568-b5d3-4a93-a1d5-14215b9b65c6 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.783400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bac54-19fb-4974-9c17-96421a6efdc2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:37.814116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.814451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:37.815603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.816139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.816600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] PATH_INFO: `/v3/projects/4174e0abae56437091b34192ee345cf1/users/8e28e32fa9374a028b56752cdb237ff9/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.819209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] RBAC: Authorizing `identity:create_grant(project_id=4174e0abae56437091b34192ee345cf1, user_id=8e28e32fa9374a028b56752cdb237ff9, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.821352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:37.822025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.822321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.822506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.822666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.823560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=7a547613dc594c2aa92e660ef8d9246a) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:37.823886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:37.826025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67179a50-9376-4ed0-aadc-746908ce0f35 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:37.832742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 70/136] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:37 2022] GET /identity/v3/role_assignments?user.id=7a547613dc594c2aa92e660ef8d9246a&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:37.834064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b778a-cc23-406c-a380-2a3bc675640a None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.834365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b778a-cc23-406c-a380-2a3bc675640a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.834662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b778a-cc23-406c-a380-2a3bc675640a None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.836574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 71/137] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:37.842294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 67/138] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:37 2022] PUT /identity/v3/projects/4174e0abae56437091b34192ee345cf1/users/8e28e32fa9374a028b56752cdb237ff9/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:28:37.842795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:37.842795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:37.843027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:37.865898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:37.867623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:37.962308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:38.004400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:38.031560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:38.141851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18007d-6aca-4b00-adc2-4bd325f0f485 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:38.182370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:38.185501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.187505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.188642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.201445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:38.209415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:38.210239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:38.211749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:38.214104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 68/140] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:38.219903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:38.329498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d241ecd-efd2-4a12-a138-7547e0bfcb48 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:38.355850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:38.367799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:38.368938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.369419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.369955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.370991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:38.371503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:38.373097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:38.382413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 73/141] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:38.388004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:38.484226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:38.496728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527c82-3ac4-4da9-9e81-f70362b7ae53 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:38.532889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:38.534170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.534689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.535200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] PATH_INFO: `/v3/users/09add49e7af745969dc73cde82e7f5b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.536587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] RBAC: Authorizing `identity:get_user(user_id=09add49e7af745969dc73cde82e7f5b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:38.538316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1317cd-32c7-42f2-af1c-7e5f35a29a5a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:38.540918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 69/142] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:38 2022] GET /identity/v3/users/09add49e7af745969dc73cde82e7f5b7 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:38.546626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:38.590202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a57f1-c29c-4956-84f1-19715a029c45 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.590479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a57f1-c29c-4956-84f1-19715a029c45 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.590689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a57f1-c29c-4956-84f1-19715a029c45 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.592370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 70/143] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:38.597281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.597574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.597854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.625038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:38.626263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:38.702935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b956a-c193-49dc-8ce7-88df1866e780 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:38.765049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:38.765712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:38.765998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:38.766276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:38.774082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 71/144] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:38.821518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:38.858782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:38.894298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:38.895810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:38.986296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:39.042062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb1edf-6076-48fb-8a5b-0526ac777469 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.091312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 74/145] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:39.094949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.094949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.094949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.094949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.096994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:39.116428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:39.132866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:39.133844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:39.134775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 72/146] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:39.140668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:39.277218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:39.294350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17de68-0ff7-4563-a7f7-8c6c4c028274 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.310750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec225f-6ed1-4fa8-b685-c3a79c583f4f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.371127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.371724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.372010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.372286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.373045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:39.373353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:39.374749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:39.377938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.378822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.379128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.379406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.381369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:39.383047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:39.384970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 75/147] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:39 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:39.390795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:39.393243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 73/148] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:39.393739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:39.402148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:39.535384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940644c6-bbe6-4318-8f96-f20a38d8ce6b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.570150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0577b-5a5f-4d63-a2bf-1b16a911d1aa None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.575686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.576479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.576849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.577203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.578128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=09add49e7af745969dc73cde82e7f5b7) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:39.578518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:39.582937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:39.587803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 76/149] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:39 2022] GET /identity/v3/role_assignments?user.id=09add49e7af745969dc73cde82e7f5b7&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:39.621555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.622679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.623124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.623559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.627631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:39.629271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:39.631242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 74/150] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:39 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:39.637165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:39.682633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:39.790279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03312ac0-3c66-4b4c-987e-e305baa78b42 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:39.842663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:39.843351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:39.843639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:39.843917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:39.930901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:39.932476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fc85d-b7d2-4cbe-b3e4-d5703710b09b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:39.952655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.043703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 77/151] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:40.049209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.139932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.181882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51490b-9fad-4ca9-be0f-b12dfb2c7b18 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:40.208962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eddfc-5aed-4c87-8a21-f31428db4e56 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.209954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eddfc-5aed-4c87-8a21-f31428db4e56 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.210475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eddfc-5aed-4c87-8a21-f31428db4e56 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.212400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 78/152] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:40.220878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab1d8-d81e-4d5b-a2ba-8540544044c2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.221448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab1d8-d81e-4d5b-a2ba-8540544044c2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.222011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ab1d8-d81e-4d5b-a2ba-8540544044c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.222338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:40.223261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.223544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.223822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.230938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:40.230938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:40.233549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 75/153] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:40.236004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.263974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2d5ab1d8-d81e-4d5b-a2ba-8540544044c2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:40.265532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2d5ab1d8-d81e-4d5b-a2ba-8540544044c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:40.348951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fafa9-cbaa-45a0-8160-5242d1a40f68 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:40.389308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:40.390211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.390664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.391554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.392567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:40.393020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:40.394629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:40.398427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.403529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 76/154] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:40.429927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 79/155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:40.467603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.598625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d973c-aa92-4d8f-952e-63b9a904da75 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.599308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d973c-aa92-4d8f-952e-63b9a904da75 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.599776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d973c-aa92-4d8f-952e-63b9a904da75 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.602126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 80/156] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:40.608052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.608657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.609126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.613464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbc8fb-1660-44d0-9765-1534107f0bbc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:40.640807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:40.642311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:40.671628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:40.672605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.673209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.673693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.686972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-5c8e9de2-820d-4b77-8c86-745ed6be2590 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:40.695965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:40.696969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:40.697727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:40.699181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.700147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 77/157] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:40.701336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153316f8-44d9-4ecf-a831-8b9cf57a2836 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.701634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153316f8-44d9-4ecf-a831-8b9cf57a2836 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.701959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153316f8-44d9-4ecf-a831-8b9cf57a2836 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.703298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 78/158] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:40.708705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.709784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.710065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.728194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:40.729627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:40.732758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 81/159] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:40.733926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.790035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.802382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 79/160] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:40.803511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.848208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe75dd6-9a9e-4d4e-b7e3-da543239e47a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:40.887217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:40.887923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.888205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.888479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.889239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:40.889598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:40.891043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:40.900721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 82/161] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:40.901343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:40.922952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8704a35-d6ef-4537-8d9d-eec2c3f19987 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:40.947160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:40.963672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:40.964484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:40.964773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:40.965050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:40.976543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:40.984526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:40.985344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:40.986108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 80/162] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:40.986728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.015575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274bd6b-1d59-428c-995e-5df6ff1a64c4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.039687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.052588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.053696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.053986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.054501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.065199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:41.073136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:41.074257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:41.075060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 83/163] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:41.075696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.099641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173e866-913a-4c56-92eb-57b2aed9d5aa None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.134748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.135851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.136142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.136414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.137631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.139151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.140945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 81/164] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:40 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.141627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.183381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.186349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84254404-8390-4bca-9361-bbc970e101bc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.220300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.221310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.221596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.222019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.222777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:41.223119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.224528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eb7b3-e14b-4ce5-9b9f-2244676d3698 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.232859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 84/165] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.234142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2185-d850-42a7-ace1-da1d6daac6a8 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.234425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2185-d850-42a7-ace1-da1d6daac6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.234750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2185-d850-42a7-ace1-da1d6daac6a8 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.235967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 85/166] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:41.237877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c2185-d850-42a7-ace1-da1d6daac6a8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.244296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e143746-e5ed-4de0-854f-bd393a0a44e1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.261068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.278098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.278769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.279088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.279366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.280104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:41.280432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.281821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.290076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 82/167] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.290753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.343145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c2185-d850-42a7-ace1-da1d6daac6a8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.376988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.377630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.377911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.378183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.390636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af637-85be-4050-a6bb-86b20cf887b0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.409365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.423206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.424081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.424365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.424638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] PATH_INFO: `/v3/users/8e28e32fa9374a028b56752cdb237ff9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.425830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] RBAC: Authorizing `identity:get_user(user_id=8e28e32fa9374a028b56752cdb237ff9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.427311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153e3e-6ea5-4bbc-ad1b-d629ad13aa53 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.428952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 83/168] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/users/8e28e32fa9374a028b56752cdb237ff9 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.430185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.430475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.430752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.446773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:41.448011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:41.451064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.452547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.490857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.514407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 84/169] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:41.523321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.558337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 86/170] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:41.559542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.612766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c145efc-154e-486b-b822-ba3688a7cacd None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.617071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.646834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.647720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.648039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.648311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] PATH_INFO: `/v3/users/7a547613dc594c2aa92e660ef8d9246a` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.649517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] RBAC: Authorizing `identity:get_user(user_id=7a547613dc594c2aa92e660ef8d9246a)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.651033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.652849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 85/171] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/users/7a547613dc594c2aa92e660ef8d9246a => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.653412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.656801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48476573-c1dd-41ef-b11e-be21b15613c9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.690946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.691612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.691890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.692151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.703841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.756820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1cc17-5862-4e13-9de3-e4b080656b6e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.760311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.761776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.791740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.792537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.792825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.793105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.794301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.795806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.797439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 86/172] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.798202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.824420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.863948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 87/173] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:41.864750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.899229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24dba6c-cbe5-4d2b-96bc-074becf85d15 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:41.913719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:41.934780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:41.935676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:41.935956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:41.936226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:41.937436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:41.938940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:41.940666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 87/174] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:41.941383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:41.968288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838df7a3-47f1-4772-84a3-5ed81b35b44d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.003986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.004844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.005149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.005421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.006592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.008255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.009898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 88/175] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:41 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:42.010650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:42.039835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:42.047826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d4e02-6273-470d-9c13-3e83b1abb2a7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.082360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.083060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.083349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.083627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.084341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.086266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.107786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 88/176] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:41 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:42.108600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:42.126345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2411e0-ddae-4ff4-af63-23febc5abec6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.153993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:42.168010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.169156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.169496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.170285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] PATH_INFO: `/v3/projects/4174e0abae56437091b34192ee345cf1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.171588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] RBAC: Authorizing `identity:get_project(project_id=4174e0abae56437091b34192ee345cf1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.173064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.175012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 89/177] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:42 2022] GET /identity/v3/projects/4174e0abae56437091b34192ee345cf1 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:42.175631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:42.229337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb6848-33d6-4175-93fe-08df2ccca975 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.271382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.272407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.272407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.272596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.273342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:42.273806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.275296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.282488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 89/178] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:42 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:42.283330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:42.288497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:42.294249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc351-af5f-45fb-bdd5-aa2b1ff6ca41 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.339574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.340466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.340747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.341020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/7a547613dc594c2aa92e660ef8d9246a/roles/ef194134b3c14a89a3feb74fa9d58f4d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.343152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, user_id=7a547613dc594c2aa92e660ef8d9246a, role_id=ef194134b3c14a89a3feb74fa9d58f4d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.345106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dc2a6-27c8-4c01-ad04-9a4be0cf256b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.365599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 90/179] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:42 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/users/7a547613dc594c2aa92e660ef8d9246a/roles/ef194134b3c14a89a3feb74fa9d58f4d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:42.420426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536aeef-f7c1-4cb8-aedb-08e10e32a257 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:42.423537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:42.464511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:42.465185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:42.465471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:42.465800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:42.466671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=4174e0abae56437091b34192ee345cf1, user.id=8e28e32fa9374a028b56752cdb237ff9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:42.467018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:42.468539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa394-78d1-464f-8bdc-15c402423d05 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:42.476062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 90/180] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:42 2022] GET /identity/v3/role_assignments?user.id=8e28e32fa9374a028b56752cdb237ff9&scope.project.id=4174e0abae56437091b34192ee345cf1&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:44.371387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b67fa-269a-4147-87b1-8ee7760d75f8 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.371899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b67fa-269a-4147-87b1-8ee7760d75f8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.371973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b67fa-269a-4147-87b1-8ee7760d75f8 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.373311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 91/181] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:44.378750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.379189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.379364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.396859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:44.398180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:44.431746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e1cec-af31-4791-8baf-79f8b40fd0eb None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.432045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e1cec-af31-4791-8baf-79f8b40fd0eb None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.432305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e1cec-af31-4791-8baf-79f8b40fd0eb None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.433695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 92/182] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:44.438716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.439043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.439330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.458708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:44.460624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:44.467173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 91/183] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:44.489694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:44.541156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 93/184] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:44.565109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:44.590976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:44.597356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33285-6531-4007-aacd-5d8768b00961 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:44.637774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:44.638495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.638782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.639093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.650768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-cc98e4b2-35dc-4dd5-911e-17758a380291 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:44.660034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:44.660894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:44.661680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 92/185] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:44.662605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55ebc-1bc9-4531-87af-9ae86389c45e None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.662887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55ebc-1bc9-4531-87af-9ae86389c45e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.663201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb55ebc-1bc9-4531-87af-9ae86389c45e None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.664705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 93/186] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:44.666942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317b42-1843-4258-ba07-378a18b97315 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.667252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317b42-1843-4258-ba07-378a18b97315 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.667519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2317b42-1843-4258-ba07-378a18b97315 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.669215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 94/187] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:44.669890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2317b42-1843-4258-ba07-378a18b97315 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:44.671870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:44.685471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6862-6373-4433-9774-5e05d86679c0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:44.719282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:44.720084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.720364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.720638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.731756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-54dc86a7-6abf-4032-9b76-073062ab6d68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:44.739406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:44.740337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:44.741116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 94/188] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:44.742338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.742338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.742455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.759157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:44.760334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:44.776037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2317b42-1843-4258-ba07-378a18b97315 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:44.809876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:44.810557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.810833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.811137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.811888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:44.812192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:44.813595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145c731-1364-4689-a5f3-beeb093f91e9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:44.822241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 95/189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:44.823538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.824004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.824219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.834304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 95/190] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:44.834304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:44.855620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:44.856806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:44.869971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:44.904436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:44.923957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 96/191] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:44.924793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:44.926849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419f59-9d94-4da3-b240-e14ea0371fab None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:44.963359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:44.964028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:44.964310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:44.964587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:44.965345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:44.965655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:44.967059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:44.979878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 96/192] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:44.979878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.030372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f454c-ed7e-4dd0-8581-26b88e6bef96 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.066470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.067387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.067655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.067934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.076166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502f52c-ef36-47ea-84c4-70cb20d0425c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.081411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.082888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.084594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 97/193] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.085395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.095352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.114387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.115427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.115707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.115978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.123380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.129603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:45.138243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:45.139169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:45.139959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 97/194] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:45.140588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.191184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2b8d6-c326-48a2-8131-a9aebbb588e5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.228723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.229518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.229806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.230080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.231282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.232758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.234412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 98/195] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.235184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.241278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ebb4-9b02-4cc9-8bae-98f785eb75bf None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.274621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.275523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.275803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.276071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] PATH_INFO: `/v3/users/7a547613dc594c2aa92e660ef8d9246a` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.277286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] RBAC: Authorizing `identity:get_user(user_id=7a547613dc594c2aa92e660ef8d9246a)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.279112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.280840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 98/196] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/users/7a547613dc594c2aa92e660ef8d9246a => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.281140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.321261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.345694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2cc5a-ba73-4ec7-b949-83a5fb75095e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.350676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.381186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.381834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.382112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.382453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.384203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85f60b-d872-4a22-be41-38c704764d42 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.418477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.419179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.419453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.419717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.420462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:45.420759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.422125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.429978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 99/197] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.430743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.452058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.453491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.525331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.530455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a458910-75df-4d93-ab43-5098e5ef1781 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.550423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 99/198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:45.551283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.558158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.564493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.565158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.565437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.565711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.566424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.567891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.588450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 100/199] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:45 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:45.597781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.693903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b610d16-94c2-434c-80a7-b0deb7198d0b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.702303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c08a5-ff7b-4253-bc4a-7be392894880 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.737602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.738266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.738552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.738828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.740189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.741079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.741366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.742082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.743003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.744475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.746340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 101/200] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.747718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.793697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.807512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:45.832009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.833631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.872220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed70c1-e230-40b0-b80e-c398e02e9b71 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:45.908912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:45.910503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:45.910789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:45.911090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:45.912341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:45.913948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:45.915833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 102/201] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:45.916439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:45.947440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 100/202] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:45.948936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:46.032950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:46.052328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed2f4-fd96-4817-87c4-f9e57a37e5d2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.063093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66374b4-6688-415f-a1ea-9f7487a247c9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.082954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:46.098847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.099783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.100242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.101071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.103994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.104835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.105183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.105625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.106633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=d1e27a3a4d954f468e5391ec9ab37485) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:46.107048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.108597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.115083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 101/203] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/role_assignments?user.id=d1e27a3a4d954f468e5391ec9ab37485&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:46.115806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:46.187552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.189545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.329477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 103/204] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:46.337261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cc7a-d25f-4d79-a0c1-93ac671cc12e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.339474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:46.381794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.382692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.383004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.383375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.384637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.386119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.388172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 102/205] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:46 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:46.388809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:46.393910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:46.403346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:46.498104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b348a9-1606-40b9-87ee-4c403b053a95 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.540389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.541579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.541910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.542192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.543674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.545136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.547189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 104/206] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:46 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:46.563814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:46.583854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024248b7-d178-4b1f-aa86-4c837404b66f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.629166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.629833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.630121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.630396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.631273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9, user.id=7a547613dc594c2aa92e660ef8d9246a) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:46.631584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.633115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c66d-bdf3-44d8-9fdd-17be9604350b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.649577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 103/207] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:46 2022] GET /identity/v3/role_assignments?user.id=7a547613dc594c2aa92e660ef8d9246a&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:46.743322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:46.759204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0de38-77dc-4e09-bf59-23f68d54f4df None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:46.813374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:46.814360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:46.814783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:46.815216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:46.816230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=d1e27a3a4d954f468e5391ec9ab37485) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:46.816696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:46.818302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b45ebc-2bcf-461f-bb2d-1945737f4adb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:46.827334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 105/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:46 2022] GET /identity/v3/role_assignments?user.id=d1e27a3a4d954f468e5391ec9ab37485&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:47.921775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb500b41-5609-4f16-b19e-bc00795781ad None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:47.922284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb500b41-5609-4f16-b19e-bc00795781ad None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:47.922284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb500b41-5609-4f16-b19e-bc00795781ad None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:47.923924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 104/209] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:47.929424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed47a-7e1e-441e-8d28-d7df394b3d44 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:47.930349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed47a-7e1e-441e-8d28-d7df394b3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:47.930847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed47a-7e1e-441e-8d28-d7df394b3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:47.947859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1e6ed47a-7e1e-441e-8d28-d7df394b3d44 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:47.949351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1e6ed47a-7e1e-441e-8d28-d7df394b3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:48.024411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:48.048030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb500b41-5609-4f16-b19e-bc00795781ad None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.113156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65274-03c9-49e8-b334-8e51647a3a0e None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.113834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65274-03c9-49e8-b334-8e51647a3a0e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.114298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65274-03c9-49e8-b334-8e51647a3a0e None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.116245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 107/211] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:48.121472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5c7b-60f3-421b-9143-11006ba0d5ed None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.122102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5c7b-60f3-421b-9143-11006ba0d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.122602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e5c7b-60f3-421b-9143-11006ba0d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.125797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.145120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c53e5c7b-60f3-421b-9143-11006ba0d5ed None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:48.146624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c53e5c7b-60f3-421b-9143-11006ba0d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:48.161887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb500b41-5609-4f16-b19e-bc00795781ad None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.204235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.205034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.205740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.206152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.207698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.210104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:48.213001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 105/212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:48.218383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.235751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 108/213] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:48.237961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb3d4-09ec-4003-bf7a-af0f721b20e3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.238420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb3d4-09ec-4003-bf7a-af0f721b20e3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.239111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb3d4-09ec-4003-bf7a-af0f721b20e3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.241037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 109/214] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:48.246071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.246351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.246622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.266125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:48.267326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:48.277179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.334684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb1142-726e-4eb9-a262-c0346cc18cfb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.340476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 110/215] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:48.341155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.383221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.384068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.384355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.384627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.385487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.387461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:48.396466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.411516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 106/216] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:48.413372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.454023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d011-61be-4f76-9c0a-86243b530600 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.501463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.503200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.503982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.504463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.522319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:48.533330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:48.534281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:48.535097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:48.536956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 111/217] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:48.542263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.547855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.556449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4d10-9000-4671-a788-db2426f2ddfe None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.598747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.599602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.599886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.600163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.612628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:48.620510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:48.621441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:48.622538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 107/218] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:48.629763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.675050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864fba0-66e6-48e0-84a7-c4545c26ca68 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.701757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.718710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.719516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.719863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.720209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.721051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:48.721932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.722818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:48.735083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 112/219] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:48.738648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.759882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab89af-88b6-4346-b921-34fcea151afe None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.804604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.805590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.805879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.806158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.806985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:48.807618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.809347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:48.819090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 108/220] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:48.826023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.831627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.874985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197116d-2380-4f20-9b4d-5d85d1b238ea None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.913522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.914617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.914902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.915225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] PATH_INFO: `/v3/users/e0923c77b26b4801bffefa9a665bae38` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.930156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] RBAC: Authorizing `identity:get_user(user_id=e0923c77b26b4801bffefa9a665bae38)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.931811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:48.933568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 113/221] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/users/e0923c77b26b4801bffefa9a665bae38 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:48.939341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:48.950022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172243d-ee30-45e8-bc0c-2a80584eb3fd None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:48.971749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:48.992594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:48.993855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:48.994365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:48.995339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:48.996857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:48.998615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ed343-5481-41f8-a5af-b2ed5ce121af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.000582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 109/222] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:49.004830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511cdc-7584-4e4c-a9d1-194844ee5870 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.005108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511cdc-7584-4e4c-a9d1-194844ee5870 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.005387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c511cdc-7584-4e4c-a9d1-194844ee5870 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.006705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 110/223] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:28:49.007501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c511cdc-7584-4e4c-a9d1-194844ee5870 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.069172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523074fc-4c43-456b-b8be-9d97e6eae84d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.096225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.109766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.110755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.111281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.111830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.116480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c511cdc-7584-4e4c-a9d1-194844ee5870 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.151005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.151908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.152190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.152462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.153683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.155163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05f2b-6d39-455f-a642-b6be9d6b3ef0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.157220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 111/224] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:49.158137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.158422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.158697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.175920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:49.177236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:49.190737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.192777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.231315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.252886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 112/225] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:49.253707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.310166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 114/226] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 20:28:49.311357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.359402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.363163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f331-f5f2-4849-af61-0c697d1be6d7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.398079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.399256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.399540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.399812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/d1e27a3a4d954f468e5391ec9ab37485/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.401779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, user_id=d1e27a3a4d954f468e5391ec9ab37485, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.403279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.420522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1941d11-3f91-4305-bfc8-4fe91c40f7ae None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.425382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 113/227] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:49 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/d1e27a3a4d954f468e5391ec9ab37485/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:49.432760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.466003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.468602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.469164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.469726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.494489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:49.510105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:49.511077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:49.511834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:49.518451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 115/228] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:49.528127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.536681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.623199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.640200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50054278-c8e6-47fb-baee-a76c115c5ff3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.666625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81665a-5396-4b53-98c2-7296eb05b6a7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.676576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.677256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.677540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.677814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.678573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:49.678881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.680525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.689328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 116/229] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:49.694670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.708758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.709569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.709863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.710145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.715775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.717274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.719159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 114/230] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:49.728211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.806155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed72d88-5a1d-400d-aca4-e71bc2cac7e8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.841800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:49.842757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:49.842976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:49.843253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:49.844566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:49.846033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:49.848180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 117/231] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:49.854541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:49.887402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.935425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf67303-24a4-425a-9fbb-f25f93ae3c3d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:49.955776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:49.998064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085fb0f-70e2-4887-b870-1d257063cff5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:50.028206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:50.029168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.029404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.029778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.030724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=e0923c77b26b4801bffefa9a665bae38) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:50.031184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:50.032770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:50.041994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:50.043220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.044379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.046428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 115/232] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/role_assignments?user.id=e0923c77b26b4801bffefa9a665bae38&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:50.046888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.055380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:50.057208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eb0ae-e6d9-4c9c-95a1-0079c857bc9c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:50.059674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 118/233] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:49 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:50.065694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:50.195495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa5e6-f6f6-47b4-9e48-0ff003697535 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:50.251517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:50.251517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.251517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.251902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/d1e27a3a4d954f468e5391ec9ab37485/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.262953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, user_id=d1e27a3a4d954f468e5391ec9ab37485, role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:50.262953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf66f0-9423-4536-8d46-d1929b850664 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:50.279290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 116/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:50 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/d1e27a3a4d954f468e5391ec9ab37485/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:50.862537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e384-c3b7-46a8-8305-bfb4c8f7cfd5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.862960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e384-c3b7-46a8-8305-bfb4c8f7cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.863138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e384-c3b7-46a8-8305-bfb4c8f7cfd5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.864781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 119/235] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:50.870060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316697-ffc9-4f19-8200-e10dfd5e070e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.870352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316697-ffc9-4f19-8200-e10dfd5e070e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.870630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316697-ffc9-4f19-8200-e10dfd5e070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.888419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bc316697-ffc9-4f19-8200-e10dfd5e070e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:50.889638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bc316697-ffc9-4f19-8200-e10dfd5e070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:50.932109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:50.987506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 117/236] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:50.995260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959594-80a9-4f2f-a1f0-97e8d0b407fe None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:50.995547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959594-80a9-4f2f-a1f0-97e8d0b407fe None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:50.995842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959594-80a9-4f2f-a1f0-97e8d0b407fe None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:50.997586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 120/237] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:51.002363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.002657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.002954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.014251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959594-80a9-4f2f-a1f0-97e8d0b407fe None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.025118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:51.026433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:51.133351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 118/238] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:51.164896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:51.186534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.189841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959594-80a9-4f2f-a1f0-97e8d0b407fe None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:51.264795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:51.265611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.265895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.266175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.288312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:51.296946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:51.297832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:51.298622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 121/239] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:51.305991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.361754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:51.373864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5195e57-6757-4acb-867b-155c49a1e402 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:51.438208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:51.438949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.439250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.439529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.441851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:51.444720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:51.446811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 119/240] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:51.454380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.517196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6c16e-087f-40a2-99f6-338697993e90 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:51.568161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:51.568839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.569122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.569398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.570364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:51.570673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:51.572119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:51.595012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 122/241] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:51.602250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.608061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:51.666090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1796450-6530-4480-b13a-ef2a84f24a8e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:51.749030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486e257-707b-4fb7-a305-e6ecb6189e57 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:51.764257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:51.764953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.765278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.765568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.766296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:51.767812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:51.789990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:51.791048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:51.791588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:51.791933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] PATH_INFO: `/v3/users/a2a01ed2f53d4314aacf679b41538250` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:51.800159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 120/242] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:51 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:51.813871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a01ed2f53d4314aacf679b41538250)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:51.815422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be30de9-5538-464f-b225-d70c44843c91 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:51.817603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 123/243] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:51 2022] GET /identity/v3/users/a2a01ed2f53d4314aacf679b41538250 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:51.823334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:51.854852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:51.977034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43972-bc28-4cce-ab0c-cd7468e273f0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.021869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.022457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.022732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.023187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.108508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:52.110012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:52.128545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.165346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66051369-2c4c-4a10-a1b5-d9bce073cdd3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.165842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66051369-2c4c-4a10-a1b5-d9bce073cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.166092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66051369-2c4c-4a10-a1b5-d9bce073cdd3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.167711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 124/244] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:52.173345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.173637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.173922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.194246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:52.195680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:52.230955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 121/245] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:52.235848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.259778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.272764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 125/246] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:52.296652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.338955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8407a-4377-4f57-b0df-b04927f6ff65 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.358419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.381619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.382493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.382877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.383079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.384343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:52.385833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:52.388546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 122/247] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:52.394465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.406067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac37db-8d16-4e4f-9aa9-f269bcb8ea51 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.442822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.443896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.444320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.444795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.456332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:52.465533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:52.466638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:28:52.467665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:52.469858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 126/248] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:52.476275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.503250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba9e2-6265-46d3-a389-a99d520ce4bb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.536221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.540372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.541054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.541342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.541619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.542471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=a2a01ed2f53d4314aacf679b41538250) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:52.542784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:52.544299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116e4a8-5b04-44cd-afaa-2f85ab359d75 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:52.550575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 123/249] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/role_assignments?user.id=a2a01ed2f53d4314aacf679b41538250&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:52.551697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdafe-8b17-4018-9a6b-266d9cb1e1d8 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.551984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdafe-8b17-4018-9a6b-266d9cb1e1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.552264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bdafe-8b17-4018-9a6b-266d9cb1e1d8 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.553511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 124/250] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:52.561845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.562135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.562416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.582500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:52.583760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:52.598105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b80ff-d0db-4e11-80ce-1cfcc45ba627 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.639460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.667101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.667101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.667101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.667101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.667501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:52.667501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:52.667501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:52.693451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 127/251] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:52.699641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.704276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 125/252] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:52.746209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:52.873093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78f55-25dd-445b-9eca-09e214e09fa4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.924674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:52.925603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.925892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.926174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.931098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262b468-948f-4cb2-9f54-eb9ac245910e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:52.937727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-1ba25fd8-662e-4ffa-a490-383a9e533c83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:52.945938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:52.946803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:52.947620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 126/253] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:52.950945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73db3-344e-4e4f-bfdc-77ac00780111 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.950945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73db3-344e-4e4f-bfdc-77ac00780111 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.950945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73db3-344e-4e4f-bfdc-77ac00780111 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.951185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 127/254] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:52.956253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:52.958753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:52.959081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:52.959431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:52.991210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:52.992485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:53.007906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.008999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.009280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.009559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.010837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.012326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.013992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 128/255] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:52 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:53.014764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.065305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:53.107889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 128/256] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:53.108762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.212395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301fbb4-b03c-4649-b69f-9c83b9b4d0dc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.218738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab39a-b864-4f95-8a50-fe87940a2201 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.248389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.249056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.249349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.249630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.294180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:53.304353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.305068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.305390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.305664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.306426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:53.306794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.308283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.325531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.327606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.337556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 129/257] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:53.338411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.447239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 129/258] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:53.447886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.448830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:53.515865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a678-574f-4a19-b9c4-698d6a45ab72 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.556015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.557091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.557378 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.557659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.569019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:53.578138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:53.579300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:53.580388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 130/259] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:53.585305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.596944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:53.701509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1be7-6616-4b21-a607-461a45fcd559 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.711328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:53.716829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc67da8-c563-4a09-9a1d-4218b24bf9e2 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.738143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.739057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.739350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.739635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.741239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.742776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.745047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 131/260] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:53.747792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.856237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.857056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.857344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.857618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] PATH_INFO: `/v3/users/e0923c77b26b4801bffefa9a665bae38` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.858650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18227262-b218-4b2e-9c1c-c9fcac544d6d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:53.858843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] RBAC: Authorizing `identity:get_user(user_id=e0923c77b26b4801bffefa9a665bae38)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.860308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.861956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 130/261] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/users/e0923c77b26b4801bffefa9a665bae38 => generated 297 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:53.862707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.902269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:53.902973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:53.903262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:53.903539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:53.904996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:53.904996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:53.906260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:53.915975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 132/262] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:53.921596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:53.960974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.034581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1a8a4-2c40-4632-906f-a8192929804c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.079212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.080092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.080373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.080650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.083360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.084830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.086823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 133/263] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:54.091693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:54.124898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83d55-0c10-4fca-a248-f65241beab9e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.193729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.194399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.194687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.197329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.198204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=d1e27a3a4d954f468e5391ec9ab37485) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:54.198522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.202113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.206534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402170f9-69ab-4232-af70-9764b161f25a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.211215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.220024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 131/264] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:53 2022] GET /identity/v3/role_assignments?user.id=d1e27a3a4d954f468e5391ec9ab37485&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:54.220921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:54.226942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.343702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.344599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.344882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.345155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] PATH_INFO: `/v3/users/d1e27a3a4d954f468e5391ec9ab37485` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.351874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] RBAC: Authorizing `identity:get_user(user_id=d1e27a3a4d954f468e5391ec9ab37485)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.353458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.355546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 134/265] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:54 2022] GET /identity/v3/users/d1e27a3a4d954f468e5391ec9ab37485 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:54.372870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4649fa-c0cd-4c5c-9c92-050598b3362b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.384323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:54.414613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.415610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.415945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.416222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/e0923c77b26b4801bffefa9a665bae38/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.419070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, user_id=e0923c77b26b4801bffefa9a665bae38, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.420637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.442060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 132/266] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:54 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/e0923c77b26b4801bffefa9a665bae38/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:54.536072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7224f6-3a13-4a9f-87fb-ae011071c9da None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.574572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.575263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.575550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.575829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.620817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.654950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.656439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830326-cbd3-4e22-97ab-f6439fdc356f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.770408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 135/267] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:54.771853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:54.779854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407c559-8804-4b71-b6b0-8dc3470e34bd None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.780154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407c559-8804-4b71-b6b0-8dc3470e34bd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.780404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407c559-8804-4b71-b6b0-8dc3470e34bd None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.782575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 136/268] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:54.789307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.789582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.789854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.823760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:54.824954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:54.859863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.907757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b963d77-0670-4c74-bfcd-a353364aca59 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:54.908007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:54.914337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 137/269] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:54.940263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:54.987291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:54.988189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:54.988556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:54.988838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:54.992615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:54.994110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:54.995953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 133/270] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:54 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:55.002165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.051362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b454440-3aef-4e8d-bae6-81536d8eed48 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.092343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.093419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.093716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.093981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.108906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:55.118764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:55.119679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:55.120458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:55.121988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 138/271] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:28:55.127038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.196985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.227769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310991b-399d-4a8a-b185-88bf2f32ae2a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.258368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111a6f2-ef49-4550-9492-b356191af3aa None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.260058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.266942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.267618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.267901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.268178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.269031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=d1e27a3a4d954f468e5391ec9ab37485) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:55.269344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.270823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125dcc-8f04-4eff-a32f-99ac0d69b4ec None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.277700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 134/272] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/role_assignments?user.id=d1e27a3a4d954f468e5391ec9ab37485&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:55.278823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdac77-63a7-47ae-bef5-d5ec870b8613 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.279159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdac77-63a7-47ae-bef5-d5ec870b8613 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.279437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdac77-63a7-47ae-bef5-d5ec870b8613 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.286308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 135/273] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:55.290173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7b93-5bfa-4103-87a2-5b625e800a68 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.290665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7b93-5bfa-4103-87a2-5b625e800a68 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.291165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea7b93-5bfa-4103-87a2-5b625e800a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.315197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.316337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-18ea7b93-5bfa-4103-87a2-5b625e800a68 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:55.316454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.317059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.317540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.317642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-18ea7b93-5bfa-4103-87a2-5b625e800a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:55.318697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:55.319319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.321465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9e78-5b5b-4273-a077-6846f4177a9b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.334685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:55.336712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582c-4ece-4e72-bb78-4ebe1637fbb4 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.337270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582c-4ece-4e72-bb78-4ebe1637fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.337765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582c-4ece-4e72-bb78-4ebe1637fbb4 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.339846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 140/275] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:55.341717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b582c-4ece-4e72-bb78-4ebe1637fbb4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.421240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 136/276] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:55.422826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.423147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.423428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.449594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:55.450754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:55.486547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b582c-4ece-4e72-bb78-4ebe1637fbb4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.521456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.545129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.547018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.547531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.547810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] PATH_INFO: `/v3/users/1c950c5931f749529eed068bf707110e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.550893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 137/277] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:55.551956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.577125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] RBAC: Authorizing `identity:get_user(user_id=1c950c5931f749529eed068bf707110e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.579015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.581119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 141/278] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/users/1c950c5931f749529eed068bf707110e => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:55.581899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.632426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.691500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc967e2-ac0a-44e4-8b96-1727158ba67d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.708732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db453d-61e8-4d75-bda9-a68f1cbed710 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.726836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.727670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.727960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.728247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.738861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:55.745766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:55.746734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:55.747733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:55.748762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:55.749340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.749340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.749340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.749340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.750663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.756954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 142/279] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:55.756954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.757132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 138/280] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:55.757132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.808882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.864274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede056c2-bf55-4583-ba58-6b6480a35ed2 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.869882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c95be-7583-4841-b9ca-3d1f8d6c2769 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:55.879335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:55.902304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.902994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.903281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.903545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.904293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:55.904596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.905668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:55.905993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.906317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:55.906594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:55.906867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:55.907723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, user.id=1c950c5931f749529eed068bf707110e, scope.system=all) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:55.908029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:55.909466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:55.919625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 139/281] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:55.919811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 143/282] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/role_assignments?user.id=1c950c5931f749529eed068bf707110e&scope.system=all&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:55.919888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:55.921195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:56.041417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba89d4-bd90-4046-8650-d01067cba820 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:56.042932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e373-e52b-4aef-b994-053932f051ac None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:56.057491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:56.084152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:56.084866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:56.085988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.086813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.087131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.087401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.088112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:56.089563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:56.091053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.091333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] PATH_INFO: `/v3/users/a2a01ed2f53d4314aacf679b41538250` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.095709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] RBAC: Authorizing `identity:get_user(user_id=a2a01ed2f53d4314aacf679b41538250)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:56.098344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:56.105809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 144/283] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:55 2022] GET /identity/v3/users/a2a01ed2f53d4314aacf679b41538250 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:56.106641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:56.115890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 140/284] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:28:55 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:56.227926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48980699-1d88-420f-a070-bb72fba4933e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:56.266612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:56.267890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.268401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.268866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.270333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:56.272036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a71f3-c497-47d8-8925-8cc03782f979 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:56.274594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 145/285] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:56 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:56.280509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:56.315557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:56.391034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66357ee-74c6-4c17-9d96-aa36e7de028b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:56.429807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:56.430713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.431028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.431302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/a2a01ed2f53d4314aacf679b41538250/roles/ef194134b3c14a89a3feb74fa9d58f4d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.433362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, user_id=a2a01ed2f53d4314aacf679b41538250, role_id=ef194134b3c14a89a3feb74fa9d58f4d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:56.434879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050850a9-2997-4fc3-8f17-e29881aa5f93 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:56.450726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 141/286] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:28:56 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/users/a2a01ed2f53d4314aacf679b41538250/roles/ef194134b3c14a89a3feb74fa9d58f4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:56.938327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b56d3-fb9e-4e31-862a-ef01fb33e68c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.938824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b56d3-fb9e-4e31-862a-ef01fb33e68c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.938898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b56d3-fb9e-4e31-862a-ef01fb33e68c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.940554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 146/287] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:56.945949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:56.946248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:56.946531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:56.971965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:56.973169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:57.069559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 142/288] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:57.116415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b56d3-fb9e-4e31-862a-ef01fb33e68c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:57.192518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:57.292537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b56d3-fb9e-4e31-862a-ef01fb33e68c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:57.344811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:57.345609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:57.345889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:57.346159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:57.365085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:57.372961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:57.373789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:57.374643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 147/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:57.380215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:57.424558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:57.524444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2eaca-f107-45e2-984a-e46a2c4616f6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:57.572572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:57.573247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:57.573533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:57.573809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:57.574560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:57.574865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:57.576279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:57.589476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 143/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:57.590983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:57.763135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfb40-f19f-4cfe-8e26-ec1083585905 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:57.772452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:57.806849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:57.808148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:57.808648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:57.809135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] PATH_INFO: `/v3/users/e0923c77b26b4801bffefa9a665bae38` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:57.810631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] RBAC: Authorizing `identity:get_user(user_id=e0923c77b26b4801bffefa9a665bae38)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:57.812308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd4b5c-09d8-4e66-b65a-0678b78091f1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:57.814252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 148/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:57 2022] GET /identity/v3/users/e0923c77b26b4801bffefa9a665bae38 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:57.820127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:57.926024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:57.947265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd66c-dca4-4f46-8c12-8047c755b68c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:57.980832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:57.981490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:57.981773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:57.982048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.066412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:58.067862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:58.118430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2511ee-2718-45cb-ba4d-43e83701684c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.118944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2511ee-2718-45cb-ba4d-43e83701684c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.119155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2511ee-2718-45cb-ba4d-43e83701684c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.120457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 149/292] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:58.126776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.127092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.127374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.145090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:58.146287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:58.196843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:58.232895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 144/293] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:28:58.237351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:58.280521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 150/294] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:58.325457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:58.388399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf7c3-8d11-49ae-bc16-a4e984d7248f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:58.448862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:58.449727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.450001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.450269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.451556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:58.453006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:58.456436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 145/295] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:28:58 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:58.461423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:58.487264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8abe0a-0046-455c-b27e-43052892c162 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:58.508367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:58.553670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:58.554531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.554808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.555099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.555907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:58.573432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:58.588984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:58.589914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:28:58.590702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:28:58.596400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 151/296] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:58.608033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:58.622982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965b96-ae0c-463c-b66c-2e45ab0f2e16 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:58.668748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:58.669426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.669721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.670585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.670741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=e0923c77b26b4801bffefa9a665bae38) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:58.671083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:58.672544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6683bd-2efd-43fd-8c68-fbd9ea1a50fd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:58.686486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 146/297] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:28:58 2022] GET /identity/v3/role_assignments?user.id=e0923c77b26b4801bffefa9a665bae38&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:58.761459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb58f42-49ff-4286-bc80-7d5153e6df51 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:58.766742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9df8c-c102-4de6-a714-792bc17ec2d8 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.767057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9df8c-c102-4de6-a714-792bc17ec2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.767333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9df8c-c102-4de6-a714-792bc17ec2d8 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.768907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 147/298] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:58.774584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f350e-3989-437c-8c85-e86e83224923 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.775243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f350e-3989-437c-8c85-e86e83224923 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.775713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f350e-3989-437c-8c85-e86e83224923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.793973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0f2f350e-3989-437c-8c85-e86e83224923 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:58.795629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0f2f350e-3989-437c-8c85-e86e83224923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:58.816696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:58.817784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.818256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.818719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.819747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:58.820470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:58.822106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:58.846326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 152/299] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:58.856224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:58.890844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 148/300] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:58.892229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1707-5968-4583-94b6-5105c87ba14b None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.892517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1707-5968-4583-94b6-5105c87ba14b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.892789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1707-5968-4583-94b6-5105c87ba14b None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.894146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 149/301] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:58.899404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:58.899732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:58.899970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:58.906797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:58.919407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:58.920616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:58.972421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.004159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 150/302] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:28:59.004806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.009349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753343-cda5-4970-9c1a-7016c593b73a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.044034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.044909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.045188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.045460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] PATH_INFO: `/v3/users/1c950c5931f749529eed068bf707110e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.046689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c950c5931f749529eed068bf707110e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.048161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.049796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 153/303] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:58 2022] GET /identity/v3/users/1c950c5931f749529eed068bf707110e => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:59.052606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.123930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf9aa-75a2-446b-b98e-e31541b73556 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.158737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.162496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.163611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.164206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.164626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.166173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2678084-3e44-4dad-b439-32348082c8c4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.175298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:59.183140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:59.184201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:59.185159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:59.187244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 151/304] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:59.188134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.206679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.207553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.207835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.208108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.209266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.211566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.213329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:59.214015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.224132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.289861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151e289-c16c-49be-afad-abdaeedac3ee None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.313425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd689a9-cc1a-4cbe-8b58-8958de204608 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.324927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.325792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.326073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.326350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] PATH_INFO: `/v3/system/users/1c950c5931f749529eed068bf707110e/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.327883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c950c5931f749529eed068bf707110e, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.329750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece76bd-ce98-4cdc-816d-9d6e75760fcf None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.343048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 152/306] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jul 13 20:28:59 2022] PUT /identity/v3/system/users/1c950c5931f749529eed068bf707110e/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:28:59.344385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748087a-e6e2-4799-92ab-6759525e1d7f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.344670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748087a-e6e2-4799-92ab-6759525e1d7f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.344945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748087a-e6e2-4799-92ab-6759525e1d7f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.350381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 153/307] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:28:59.350381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748087a-e6e2-4799-92ab-6759525e1d7f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.360441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.361134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.361413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.361735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.362512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:59.362815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.364268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4537a8-b558-440d-a5a6-58fb32360210 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.373551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 155/308] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:59.375007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.375241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.375513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.393765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:28:59.395024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:28:59.418673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.461923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.465856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748087a-e6e2-4799-92ab-6759525e1d7f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.483936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 156/309] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:28:59.487125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.517808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.518518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.518809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.519118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] PATH_INFO: `/v3/groups` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.519849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.521313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.537636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 154/310] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jul 13 20:28:59 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:28:59.538900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.610080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d874a-9537-4876-ab87-d9a0bf6a381f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.650159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.651537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.652053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.652594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] PATH_INFO: `/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.662163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d54d4d-fd25-4921-b4d4-4b33232309ea None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.680482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] RBAC: Authorizing `identity:get_user(user_id=0f61b7b1a31d4c4593a0837eb4a8fd2c)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.682580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.685145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 157/311] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:59.690973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.701111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.701917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.702196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.702469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.708901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.717890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:28:59.727300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:28:59.728181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:28:59.729320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 155/312] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:28:59.734173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:28:59.760917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:28:59.815772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc3a6-1deb-4a14-ab71-43de86f7f27a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.852256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.853202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.853494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.853859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.854909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, user.id=0f61b7b1a31d4c4593a0837eb4a8fd2c, scope.system=all) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:59.855301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.856858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.862485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 158/313] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/role_assignments?user.id=0f61b7b1a31d4c4593a0837eb4a8fd2c&scope.system=all&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:28:59.867832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489952f-85ce-41e2-8907-6ebee56da7fc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:28:59.908278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:28:59.909301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:28:59.909784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:28:59.910294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:28:59.911309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:28:59.911829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:28:59.913493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:28:59.924028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 156/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:28:59.932867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:00.020104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:00.044193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f572d9-2730-4a1e-8e95-5002ce962de4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:00.080084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:00.081348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:00.081847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:00.082310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] PATH_INFO: `/v3/users/a2a01ed2f53d4314aacf679b41538250` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:00.083914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] RBAC: Authorizing `identity:get_user(user_id=a2a01ed2f53d4314aacf679b41538250)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:00.085590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:00.087835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 159/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:28:59 2022] GET /identity/v3/users/a2a01ed2f53d4314aacf679b41538250 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:00.093073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:00.178027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:00.197846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef923a-6cb9-4f45-a923-581ab12416ef None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:00.231254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:00.231902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:00.232183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:00.232457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:00.300208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:00.301734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:00.383261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:00.403156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 157/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:00.408695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:00.516018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881b4f7-2501-4d6f-8037-48f7d933988e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:00.550381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:00.551626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:00.552050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:00.552491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:00.553817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:00.555499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07485e6-0460-4100-8d44-5eb4456d8fc3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:00.557344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 160/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:00 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:00.563482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:00.666086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2ba40-1c95-40c9-99da-bbf2890721cc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:00.700019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:00.700682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:00.700966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:00.701244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:00.702082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, scope.project.id=b3334a3d1dc545649c5fdc791825cba0, user.id=a2a01ed2f53d4314aacf679b41538250) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:00.702394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:00.703879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554e022-bae4-4118-8f13-e322a9da9b00 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:00.710524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 158/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:00 2022] GET /identity/v3/role_assignments?user.id=a2a01ed2f53d4314aacf679b41538250&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:01.406864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7df7c-3554-4f22-a3f3-7fee880b5ad2 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.407288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7df7c-3554-4f22-a3f3-7fee880b5ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.407455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7df7c-3554-4f22-a3f3-7fee880b5ad2 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.408996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 161/319] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:01.414804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f6b6-b834-4797-b649-208fb8e2622b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.415103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f6b6-b834-4797-b649-208fb8e2622b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.415389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f6b6-b834-4797-b649-208fb8e2622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.433067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a641f6b6-b834-4797-b649-208fb8e2622b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:01.434261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a641f6b6-b834-4797-b649-208fb8e2622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:01.479227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:01.505155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 159/320] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:01.529642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7df7c-3554-4f22-a3f3-7fee880b5ad2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:01.548508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:01.645938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7df7c-3554-4f22-a3f3-7fee880b5ad2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:01.660371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e88fc-cc6f-40ed-b3a0-68286bd86455 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.660748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e88fc-cc6f-40ed-b3a0-68286bd86455 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.661102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e88fc-cc6f-40ed-b3a0-68286bd86455 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.663071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 160/321] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:01.669452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.669816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.670241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.685126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:01.685915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.686192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.686456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.688369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:01.689740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:01.696744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:01.704350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:01.705237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:01.706156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 162/322] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:01.711718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:01.764491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 161/323] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:01.786519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:01.791069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:01.819558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7a5af-83c7-4751-8880-cc7a25c6ef4a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:01.855343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:01.856009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.856293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.856562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.857340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:01.857641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:01.859047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:01.867316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 163/324] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:01.873307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:01.894573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3bbe-5bc1-4226-b8a6-0fd911f91b79 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:01.902555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:01.936804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:01.938048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:01.938332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:01.938897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:01.940350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:01.941967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:01.944511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 162/325] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:01.949940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:01.981355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c28c7-70bb-426e-9b59-26faeb224aaf None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.014767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.015674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.015941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.016210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] PATH_INFO: `/v3/users/1c950c5931f749529eed068bf707110e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.017522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] RBAC: Authorizing `identity:get_user(user_id=1c950c5931f749529eed068bf707110e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.019019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f15f-60d1-415b-8b61-f7f6f05bc6ec None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.020649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 164/326] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:29:01 2022] GET /identity/v3/users/1c950c5931f749529eed068bf707110e => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:02.021798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3f66-a126-4e6e-8ddc-92ba7fdb5843 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.022080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3f66-a126-4e6e-8ddc-92ba7fdb5843 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.022355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3f66-a126-4e6e-8ddc-92ba7fdb5843 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.023649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 165/327] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:02.026505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3f66-a126-4e6e-8ddc-92ba7fdb5843 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:02.030155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:02.051340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332e3d-0e48-44c1-8c19-15c9d091a998 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.084952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.085992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.086135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.086375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] PATH_INFO: `/v3/groups` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.087089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.088555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00c21-9c7a-44b2-bb05-2751039b78c8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.103064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 163/328] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jul 13 20:29:01 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:29:02.104277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.104564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.104841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.129178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:02.130735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:02.132236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3f66-a126-4e6e-8ddc-92ba7fdb5843 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.164662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:02.176996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.177663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.178713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.178713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.179148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] RBAC: Adding query filter params (role.id=ad923c69cc724dfd804ae86198b268c0, user.id=1c950c5931f749529eed068bf707110e, scope.system=all) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:02.179461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.181094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.197942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 166/329] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 13 20:29:02 2022] GET /identity/v3/role_assignments?user.id=1c950c5931f749529eed068bf707110e&scope.system=all&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:02.214812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 164/330] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:02.237774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:02.309748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:02.351421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd138-dc83-46f1-828b-68491b7b1563 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.387467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.388554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.388839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.389118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.401277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:02.409384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:02.410719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:02.411585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:02.417372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:02.528263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fe5c9-06ab-4b4e-8799-c56a10774d72 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.563012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.563986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.564432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.564899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.565795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:02.566247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.567797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.576903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 165/332] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:02.582571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:02.696297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d092dc-354f-4c78-82b2-a2c0c5fb3c1e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.722602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:02.736724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.737612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.737892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.738161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] PATH_INFO: `/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.739411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] RBAC: Authorizing `identity:get_user(user_id=0f61b7b1a31d4c4593a0837eb4a8fd2c)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.740870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e2d8f-c78e-4d9f-a868-79c700c9abde None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.742891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 168/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:29:02 2022] GET /identity/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:02.748461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:02.787152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:02.864719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af252ba-4b94-4708-8f91-d8a3ca24b5f3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:02.902274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:02.903175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:02.903460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:02.903738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] PATH_INFO: `/v3/system/users/0f61b7b1a31d4c4593a0837eb4a8fd2c/roles/ef194134b3c14a89a3feb74fa9d58f4d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:02.905254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f61b7b1a31d4c4593a0837eb4a8fd2c, role_id=ef194134b3c14a89a3feb74fa9d58f4d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:02.906663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723f071-5579-4bf3-90da-7fd68ee2d111 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:02.918168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 166/334] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jul 13 20:29:02 2022] PUT /identity/v3/system/users/0f61b7b1a31d4c4593a0837eb4a8fd2c/roles/ef194134b3c14a89a3feb74fa9d58f4d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:04.700570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fb2-4633-4e12-a83d-667d74c2b7f6 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:04.701077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fb2-4633-4e12-a83d-667d74c2b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:04.701334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8fb2-4633-4e12-a83d-667d74c2b7f6 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:04.703078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:04.709239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:04.709967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:04.710413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:04.732724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16b48-5c45-4e91-a002-76d8dadc9c03 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:04.733316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:04.733532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16b48-5c45-4e91-a002-76d8dadc9c03 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:04.733997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16b48-5c45-4e91-a002-76d8dadc9c03 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:04.734508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:04.736049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 170/336] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:04.740722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:04.741257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:04.741864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:04.767929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:04.769477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:04.811863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 167/337] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:04.862535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:04.879464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 171/338] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:04.891053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:04.913959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:04.982674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7ef08-10c1-4f57-b3da-9b6062f4162a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.018000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.019235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.019718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.020199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.031423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:05.040110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:05.040998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:05.041757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:05.044448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 168/339] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:05.051692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.096869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad9117-cf96-4386-b1c3-be9d114c9d08 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.135400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.142027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.157477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.158282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.158640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.159118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.165284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4cfc0-7581-4c3e-9573-4c4af87e51a2 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.170660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-16352259-6660-43bd-8ac4-4fd2f990c6f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:05.178743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:05.179798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:05.180558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:05.181148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 172/340] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:05.182062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e108f5-fa9a-4860-afc1-e2454c8fcc9c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.182345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e108f5-fa9a-4860-afc1-e2454c8fcc9c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.182618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e108f5-fa9a-4860-afc1-e2454c8fcc9c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.188554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 173/341] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:05.190129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e108f5-fa9a-4860-afc1-e2454c8fcc9c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.211799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.212838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.213336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.213869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.214986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:05.215506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:05.217116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f59188-bb9a-4b72-ae85-308229ca9f68 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:05.227496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 169/342] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:05.229466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.229975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.230442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.254477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:05.256242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:05.312114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e108f5-fa9a-4860-afc1-e2454c8fcc9c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.329917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 170/343] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:05.331149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.359464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.360195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.360530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.360836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.361598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:05.361937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:05.363635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:05.378868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 174/344] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:05.388178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.414517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.446400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fe69-bd84-424f-a93a-1ca2e8bf6c4e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.449478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.484557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.485808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.486372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.486801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.513282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99f384-c804-484f-8a8c-00962d3114da None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.550048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.550720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.551059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.551342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.570750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:05.572331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:05.635262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:05.636743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:05.656846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.692044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 171/345] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:05.692904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.711388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.743619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:05.744475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.803380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38586e-b220-48c0-a1aa-92b6bf25579e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.839155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.839956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.840234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.840508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.845041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58ae1d-aa16-44c2-b9d5-1d0eadc9b154 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:05.851542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:05.859131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:05.860078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:05.860871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 172/347] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:05.861515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.881530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:05.882439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:05.882723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:05.883016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:05.884475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:05.885931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:05.887809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 176/348] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:05.888400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:05.900011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.919292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:05.972427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccba2d-facd-4d97-b27a-ceb2a4ecec34 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.012841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.013707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.013993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.014258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.015472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.018333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08abf5-586f-4d33-b25b-bb72d068ae83 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.019253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.021151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 173/349] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.021746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.055722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.056488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.056772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.057047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.057800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:06.058103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.059705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c956-4c3d-43e3-9e8a-6e3bd3b4f221 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.070044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 177/350] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.071568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9622-f0c2-4f04-a785-7fbdfdda0298 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.071859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9622-f0c2-4f04-a785-7fbdfdda0298 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.072138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9622-f0c2-4f04-a785-7fbdfdda0298 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.073696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 178/351] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:06.074407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e9622-f0c2-4f04-a785-7fbdfdda0298 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.132974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.136135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdb7f3-2abc-44e1-be21-33fc0acbb6b0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.168878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.173238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.174269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.174674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.175150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.182154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.183871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921dbfc-0b86-4714-ad93-df318fd81029 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.185973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 174/352] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.187360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.187743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.188112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.194287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e9622-f0c2-4f04-a785-7fbdfdda0298 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.205373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:06.206560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:06.232470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.233259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.233534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.233805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.236068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.237655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.239445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 179/353] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.240210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.283274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 175/354] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:06.284356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.393413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7a19-f27e-4d33-a7e7-94afe6a2674c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.413120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.421414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6f783-77b5-4f5e-8838-e4b2660d5a3d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.440753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.441790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.442067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.442339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.456626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.467063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.468098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.468382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.468660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.469499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:06.469806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.471786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.479966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 176/355] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.481550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.539033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.539033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.680069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a88c9-20ef-4ec8-a700-83de152c2f30 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.695712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 180/356] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:06.698942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.752295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.752971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.753249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.753521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.754459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:06.754829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:06.755784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.757111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91270b-83aa-4c80-9a75-15229c6bf4ba None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:06.764503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 177/357] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:06.775805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3408f-496e-4449-bb89-277a0c38b160 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.776145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3408f-496e-4449-bb89-277a0c38b160 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.778993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3408f-496e-4449-bb89-277a0c38b160 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.778993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 178/358] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:06.779783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3408f-496e-4449-bb89-277a0c38b160 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:06.832446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:06.857503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e530e1-9cef-421a-8806-07fcf3bf7941 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:06.901525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:06.902571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.902856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.903182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.921715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-1c1d56c6-20cb-4e12-b733-0245c2014715 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:06.929697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:06.930696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 20:29:06.931566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:06.935016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 181/359] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:06.936469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345230-7655-4f90-a08f-44846fa8898b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:06.936752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345230-7655-4f90-a08f-44846fa8898b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:06.937023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2345230-7655-4f90-a08f-44846fa8898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:06.958955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b2345230-7655-4f90-a08f-44846fa8898b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:06.960364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b2345230-7655-4f90-a08f-44846fa8898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:06.982240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3408f-496e-4449-bb89-277a0c38b160 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.069417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.071416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.073009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.073299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.076341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.080101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9715-a1ed-4eea-96e5-a91b85d4243e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.082722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 179/360] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:06 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.083966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6dd3-0537-4aab-8463-b1dc255fe676 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.084251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6dd3-0537-4aab-8463-b1dc255fe676 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.084523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac6dd3-0537-4aab-8463-b1dc255fe676 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.085881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 180/361] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:07.088456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac6dd3-0537-4aab-8463-b1dc255fe676 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.090325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 182/362] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:07.092427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.092685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.092963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.131756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:07.133311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:07.167365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.231796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 183/363] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:07.232915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.276048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.287929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac6dd3-0537-4aab-8463-b1dc255fe676 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.328511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.329668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.329668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.329847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.330441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:07.330743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.332341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.341452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 181/364] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.342194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.364415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a4ce9-6be8-4303-9336-66fdb4fdb550 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.402780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.403672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.403957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.404223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.405400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.406844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.408525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 184/365] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.409287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.445788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.458491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78296dbd-1e50-4a28-b437-c5b440ecc560 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.497678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.498686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.499105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.499482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.510747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:07.518817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd8c39-fcb3-47ca-92f4-c2d40f570f18 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:07.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:07.519956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:07.520726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:07.525493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 182/366] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:07.526386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.542964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.558678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.559508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.559789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.560066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.572478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:07.580836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:07.581723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:07.582485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:07.583614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 185/367] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:07.586851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.636401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd19f7-822c-448e-9c54-0c991f5e1384 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.672521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.673511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.673802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.674081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] PATH_INFO: `/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.675348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] RBAC: Authorizing `identity:get_user(user_id=0f61b7b1a31d4c4593a0837eb4a8fd2c)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.676813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.679008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 183/368] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/users/0f61b7b1a31d4c4593a0837eb4a8fd2c => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.680054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.680631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.695286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ea87c-ea4d-4f5a-8776-c3520747c7b4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.732880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.733649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.733999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.734345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.735486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=b3334a3d1dc545649c5fdc791825cba0) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:07.736120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.737469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.743639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 186/369] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.744595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.770838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.793604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722f01-ed52-4ab0-97c3-7151bc2cb6ab None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.831736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.832722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.833611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.834041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.835111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:07.835827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.837499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.853098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 184/370] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.854432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.860602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c012bb-f189-433f-a980-7f2abeff523f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:07.900300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:07.900300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:07.900300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:07.900632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:07.901263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:07.902137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:07.903262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:07.912814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 187/371] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:07.913801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:07.967311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:07.970519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331299af-c873-4baf-bd83-748fb82cf1a5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.008557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.009614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.010069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.010527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.011585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] RBAC: Adding query filter params (role.id=ef194134b3c14a89a3feb74fa9d58f4d, user.id=0f61b7b1a31d4c4593a0837eb4a8fd2c, scope.system=all) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:08.012108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.013776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.025363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.030259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 185/372] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/role_assignments?user.id=0f61b7b1a31d4c4593a0837eb4a8fd2c&scope.system=all&role.id=ef194134b3c14a89a3feb74fa9d58f4d => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:08.031177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.036881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4220-e00d-4b67-9620-8d864177cd11 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.092783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.093718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.094255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.094734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.152061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc497e-af8c-4af3-9c2c-b4c0c7a024a8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.177310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.180126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.196276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.197055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.197414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.197766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.203339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.275297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.277683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.279522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.322367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 188/373] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:08.332049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.404403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 186/374] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:08.409506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.478224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96ca0-f3cc-4986-8299-f9cbe40900ed None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.515478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.520458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.521605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.521915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.522248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.524181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.525839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.528209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 189/375] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:08.549292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.550474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.553877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f45d9-ba90-48c5-a9df-ef123c24fc9e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.593452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.594380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.594674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.595076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] PATH_INFO: `/v3/projects/1b2e1869a6a84cb5949adf32c69b433a` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.600337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] RBAC: Authorizing `identity:get_project(project_id=1b2e1869a6a84cb5949adf32c69b433a)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.602267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.604128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 187/376] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/projects/1b2e1869a6a84cb5949adf32c69b433a => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:08.609748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.733707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ec671-6315-4786-83d7-c13be89fbd41 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.759418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c74c-3f7f-4af6-9db0-9dc45b2f726f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:08.797028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.797900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.798176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.798468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.800345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.801796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.803514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 190/377] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:08.810453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.815660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:08.816527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:08.816809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:08.817083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] PATH_INFO: `/v3/groups/d80563d1bb06414691e11f20e82b7337` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:08.832947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] RBAC: Authorizing `identity:get_group(group_id=d80563d1bb06414691e11f20e82b7337)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:08.834413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:08.836649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 188/378] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/groups/d80563d1bb06414691e11f20e82b7337 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:08.843311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:08.907310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:08.919611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:09.004513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb4215-cc7d-4650-b209-5fe0cd2c106b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:09.051640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23f17-6cfd-4e51-b0f6-13ee4b42e97e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:09.061420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:09.062085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.062361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.062630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.063497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=b3334a3d1dc545649c5fdc791825cba0) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:09.063803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:09.065252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06baf4-e8eb-4b4c-8eff-be0f4f5c4bfb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:09.074860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 191/379] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:09.100179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:09.101266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.101710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.101991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.102903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] RBAC: Adding query filter params (group.id=d80563d1bb06414691e11f20e82b7337, role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=1b2e1869a6a84cb5949adf32c69b433a) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:09.103250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:09.104773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de0536-9993-4ba9-99a9-09ecf634c4af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:09.111876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 189/380] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:08 2022] GET /identity/v3/role_assignments?group.id=d80563d1bb06414691e11f20e82b7337&scope.project.id=1b2e1869a6a84cb5949adf32c69b433a&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:09.218931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407bda-de87-4e65-be8b-940b23c476b3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.219261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407bda-de87-4e65-be8b-940b23c476b3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.219491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407bda-de87-4e65-be8b-940b23c476b3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.221195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 192/381] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:09.227527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.227835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.228089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.260224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:09.261544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:09.345923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 190/382] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:09.372679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407bda-de87-4e65-be8b-940b23c476b3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:09.500751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407bda-de87-4e65-be8b-940b23c476b3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:09.516055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:09.542128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:09.543024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.543304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.543575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.557419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:09.565854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:09.568026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:09.569991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 193/383] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:09.578959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:09.613378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:09.706671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96246-92bb-4ae8-925c-eda0edd5b4fd None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:09.756252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:09.756849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.757131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.757607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.758416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:09.758722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:09.760137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:09.774490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 191/384] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:09.780128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:09.903816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887a84-760e-4ea7-97a4-c951986a0ebf None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:09.941928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:09.942791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.943097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.943371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.944561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:09.946400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95089f-b07a-478a-b711-9c70fcff46c2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:09.948345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 194/385] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:09 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:09.953894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:09.955465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fd7c-80c9-4ae4-bd1f-163a5466076f None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.955752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fd7c-80c9-4ae4-bd1f-163a5466076f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.956028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fd7c-80c9-4ae4-bd1f-163a5466076f None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.957551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 195/386] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:09.962845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:09.963164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:09.963444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:09.996031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:09.997224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:10.039521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.104782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 196/387] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:10.119325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.135623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87c8ed-f8ff-45f5-8d40-41603c8eb6eb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.143980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.188933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.189814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.190095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.190366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.191577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:10.193027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:10.197206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:09 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:10.214065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.270357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd4904-b02e-46cb-9f32-c625d635320a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.311919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.312700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.312979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.313247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.332179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:10.341967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:10.342874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:10.344157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 197/389] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:10.349155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.384085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.392106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28876b4-d48e-4283-b716-127901d1b160 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.446583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.447532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.447942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.448219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/groups/0e4364e19642446ba7a31edd9448070b/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.454074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, group_id=0e4364e19642446ba7a31edd9448070b, role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:10.456285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065279c-1274-40b2-9a68-6cf43f02d68e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:10.474479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b09c89-6015-40d2-ada0-55951b3707ff None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.482098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 193/390] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 13 20:29:10 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/groups/0e4364e19642446ba7a31edd9448070b/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:29:10.485892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a370df-9a78-4e65-b998-ff9298b4c741 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.486445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a370df-9a78-4e65-b998-ff9298b4c741 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.487012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a370df-9a78-4e65-b998-ff9298b4c741 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.489189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 194/391] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:10.498421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.498713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.499028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.534027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:10.535315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:10.555926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.556619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.556901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.557176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.557951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:10.558261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:10.559697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:10.566110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.576059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 198/392] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:10.582147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.678102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 195/393] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:10.715100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.735883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.744308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9147298-32c9-4a28-a8ee-ad0d7d5810a3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.781272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.782278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.782562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.782979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.784154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:10.785792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:10.787740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 199/394] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:10.794296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.830655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61749bd8-846f-446e-961d-99f85548e8c9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.868799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.869605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.869891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.870197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.881806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:10.890410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:10.891378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:10.892137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 196/395] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:10.905968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.906757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bec5e-76d0-43cb-a5c0-8f78cabad389 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:10.917927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:10.945595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:10.947156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:10.947593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:10.948001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:10.949358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:10.950967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:10.953305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 200/396] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:10.959045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:10.992149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:11.020778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a57551-a79d-42c7-94d6-3208bb28223a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.058877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.059721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.059970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.060252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.061149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:11.061420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:11.062941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:11.070364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623cba1-1309-46c8-8f3a-ef8504730a19 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.072799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 197/397] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:11.078468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:11.108754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.109966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.110384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.110870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/groups/0e4364e19642446ba7a31edd9448070b/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.113102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6bbc40942b34b86976ba1a5b7efa0b9, group_id=0e4364e19642446ba7a31edd9448070b, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:11.114800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:11.132791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 201/398] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 13 20:29:10 2022] PUT /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9/groups/0e4364e19642446ba7a31edd9448070b/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:29:11.154795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:11.194216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98125e42-a355-4a9a-9959-6f59f09951b0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.233529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.234413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.234697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.235015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.236307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:11.237906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:11.239960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 198/399] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:11 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:11.245929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:11.376960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:11.389724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55c4cf-a609-474e-bf0c-22216ba98c38 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.434636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.435909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.436208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.436694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.438014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:11.439497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a40de-98fd-435e-a312-4286dfc34904 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:11.441533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 202/400] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:11 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:11.447230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:11.555391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe92fa7-6c26-4c2d-910a-65b6e1dfe58d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.592819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.594068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.594568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.595060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/groups/0e4364e19642446ba7a31edd9448070b/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.597282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, group_id=0e4364e19642446ba7a31edd9448070b, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:11.598996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:11.603090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:11.617810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea8341-d128-4420-83bb-9eb5dbca020f None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.618502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea8341-d128-4420-83bb-9eb5dbca020f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.619045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea8341-d128-4420-83bb-9eb5dbca020f None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.620968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 203/401] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:11.625823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 199/402] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 13 20:29:11 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/groups/0e4364e19642446ba7a31edd9448070b/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:29:11.627772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad736be-6256-426f-a888-1696862a457e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.628286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad736be-6256-426f-a888-1696862a457e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.628783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad736be-6256-426f-a888-1696862a457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.648090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1ad736be-6256-426f-a888-1696862a457e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:11.652066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1ad736be-6256-426f-a888-1696862a457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:11.735355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 204/403] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:11.770478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:11.895045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1894c-2040-4586-b186-00094aaca032 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:11.930802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:11.931661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:11.931943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:11.932215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:11.942999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-987e6cac-ed98-45c5-947f-3c4032602a11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:11.951216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:11.952140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:11.953147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 200/404] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:11.960067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad736be-6256-426f-a888-1696862a457e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.071951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:12.084163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad736be-6256-426f-a888-1696862a457e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.117845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54aa5-379c-4479-b860-33f47a56ec62 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.118502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54aa5-379c-4479-b860-33f47a56ec62 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.118502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54aa5-379c-4479-b860-33f47a56ec62 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.120100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 201/405] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:12.120493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.121177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.121452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.121721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.122473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:12.122832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:12.124233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:12.126153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.126472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.126822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.133447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 205/406] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:12.138903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.159216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:12.160444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:12.233592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:12.245387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7de4-98fc-4771-b9a2-952639bdc413 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.254054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 202/407] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:12.280411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.280780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.281350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.281629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.281906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.283129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:12.284684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:12.286578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 206/408] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:12 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:12.292455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.317790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:12.406981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1658c95-030d-44dc-908f-8aecb9165d87 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.443642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.444693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.445141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.445723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.447110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:12.448643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:12.451008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 207/409] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:12 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:12.456802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.485761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f5849-c34b-4a0d-b80a-af95c91b033a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.552897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:12.564833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7a71e-aadd-45c9-8760-d71ad88aa2af None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.582950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.583763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.584049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.584327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.604743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.605757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.606107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.606444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0/groups/0e4364e19642446ba7a31edd9448070b/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.608476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:12.609020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3334a3d1dc545649c5fdc791825cba0, group_id=0e4364e19642446ba7a31edd9448070b, role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:12.610571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:12.621703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:12.622688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:12.623963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:12.625468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 208/411] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 13 20:29:12 2022] PUT /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0/groups/0e4364e19642446ba7a31edd9448070b/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:29:12.629428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:12.723610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:12.799445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64bdb-b340-416f-9549-4c21ff5bbf51 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:12.844292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:12.844959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:12.845239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:12.845512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:12.846260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:12.846561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:12.848016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:12.857392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 204/412] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:12.863236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:13.001982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e89a5-2b6b-4fff-b298-556b3fe5dd52 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:13.042272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:13.043168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.043450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.043779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] PATH_INFO: `/v3/groups/d80563d1bb06414691e11f20e82b7337` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.045007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] RBAC: Authorizing `identity:get_group(group_id=d80563d1bb06414691e11f20e82b7337)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:13.046457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:13.052495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 209/413] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:12 2022] GET /identity/v3/groups/d80563d1bb06414691e11f20e82b7337 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:13.058105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:13.197181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc94af-b725-4db9-a342-0c45eef46a77 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:13.210310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:13.238100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:13.239004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.239286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.239555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] PATH_INFO: `/v3/projects/1b2e1869a6a84cb5949adf32c69b433a` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.240741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] RBAC: Authorizing `identity:get_project(project_id=1b2e1869a6a84cb5949adf32c69b433a)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:13.242315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a9016-c275-4046-930f-9dbc406deea6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:13.244039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 205/414] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:13 2022] GET /identity/v3/projects/1b2e1869a6a84cb5949adf32c69b433a => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:13.249703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:13.265838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:13.354658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40c3f-d4e0-4a00-8120-36959489ff01 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:13.388905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:13.389799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.390074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.390343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] PATH_INFO: `/v3/projects/1b2e1869a6a84cb5949adf32c69b433a/groups/d80563d1bb06414691e11f20e82b7337/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.392293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b2e1869a6a84cb5949adf32c69b433a, group_id=d80563d1bb06414691e11f20e82b7337, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:13.393744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4493-68a2-41fd-a7c3-be9c100c0fe4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:13.407571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 210/415] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 13 20:29:13 2022] PUT /identity/v3/projects/1b2e1869a6a84cb5949adf32c69b433a/groups/d80563d1bb06414691e11f20e82b7337/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:13.570381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac2bb-fe9c-48b8-b69e-3890b56dc520 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.570577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac2bb-fe9c-48b8-b69e-3890b56dc520 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.570845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac2bb-fe9c-48b8-b69e-3890b56dc520 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.572622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 206/416] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:13.577947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.578237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.578515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.595560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:13.596742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:13.671785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 211/417] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:13.695299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac2bb-fe9c-48b8-b69e-3890b56dc520 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:13.831741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac2bb-fe9c-48b8-b69e-3890b56dc520 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:13.882506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:13.883357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:13.883642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:13.883918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:13.898614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a2116133-270f-4494-a3c1-177142f6387b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:13.906876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:13.907759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:13.908958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 207/418] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:13.914118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:13.918813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.024437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31746-42b3-4d37-a9be-0dab1933b04f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.024763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31746-42b3-4d37-a9be-0dab1933b04f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.024991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31746-42b3-4d37-a9be-0dab1933b04f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.026622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 208/419] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:14.044701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.044998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.045257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.064544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:14.065719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64af52-2682-4be3-b4e0-88690ed08f5c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.066465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:14.104324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.146779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.147485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.147762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.148087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.149404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:14.149942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.153478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 209/420] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:14.153940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:14.163491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 212/421] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:14.172040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.201872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.271933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.310132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25be6b1-3694-49f0-95ed-ce10948718a1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.323275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2ee1-16d5-4d31-ae39-becc3d8cc32d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.355628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.356625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.357098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.357545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.375514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.376310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.376588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.376861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.396883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:14.411930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:14.412824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:14.413662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 213/422] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:14.423351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.424897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.463765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.465645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996626-fb2d-4220-832b-164bc8664d91 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:14.549703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5c85c-4109-4fae-b295-21b93894feac None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.568969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 210/423] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:14.571085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8e4a-5236-4d79-a91a-ff3cee253da0 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.571645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8e4a-5236-4d79-a91a-ff3cee253da0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.572131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8e4a-5236-4d79-a91a-ff3cee253da0 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.573959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 211/424] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:14.574888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8e4a-5236-4d79-a91a-ff3cee253da0 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.586675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.598277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.598989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.599694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.599977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.601204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] RBAC: Adding query filter params (name=member) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:14.601730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.603434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59697cf-a61a-4a6f-980a-f01b56cc92be None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:14.619003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:14.620301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.620594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.620875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.638075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:14.639303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:14.649386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.687959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8e4a-5236-4d79-a91a-ff3cee253da0 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.726952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 215/426] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:14.726952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.728623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.729716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.730194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.730687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.732095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.739304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:14.741675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 212/427] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:14.746899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.828423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ced3d0-6fa8-4343-9f5f-b229c5eec4d4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.847672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.857359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2241-0dd8-466c-b33a-6836d4b63014 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:14.867058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.867908 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.868089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.868375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.893333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:14.894500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:14.895017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:14.895482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:14.896900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.898892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:14.900789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 213/428] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:14.901755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:14.905004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:14.955692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:14.957839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.012109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c14878-1e93-4b32-a3b7-242a4951aec8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.055963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.057046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.057333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.057613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.070394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:15.076898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 216/429] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:15.077731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-ba2e5639-3799-4e00-827e-7adaabd5aa06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:15.081937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:15.083033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 20:29:15.083901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:15.084496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 214/430] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:15.085725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7315a6-e3da-44f9-8643-84355154a975 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.085906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7315a6-e3da-44f9-8643-84355154a975 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.086181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7315a6-e3da-44f9-8643-84355154a975 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.087623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 215/431] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:15.091935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7315a6-e3da-44f9-8643-84355154a975 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.104549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.159016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.192475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13a35-e017-426a-9522-f2fc096a41fc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.199134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7315a6-e3da-44f9-8643-84355154a975 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.228504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.229152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.229434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.229702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.230531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:15.230838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.232290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360d727-6d5e-4745-aa28-c0df6b15367f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.234739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.235620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.235903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.236185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] PATH_INFO: `/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.237345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] RBAC: Authorizing `identity:get_project(project_id=f6bbc40942b34b86976ba1a5b7efa0b9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.238949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.245594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 216/432] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/projects/f6bbc40942b34b86976ba1a5b7efa0b9 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.245594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.247260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 217/433] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.248601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.249737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.249737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.280981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:15.283245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:15.368540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 218/434] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:15.369594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.371675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf810908-9e68-43cb-91fd-d7c8c311bd88 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.385412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.414055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.423269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.424625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.424937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.425223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.425989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:15.426298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.428134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.442944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 217/435] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.442944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.496485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b1ec3-f3cc-40c9-83c6-d486e98f66c6 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.537962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.539656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.539943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.540220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.541431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.542880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.544543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 219/436] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.545300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.576085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeaae7-829e-42ff-9c15-d69aaf277bb1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.619044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.619861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.620146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.620422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.628306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.634088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:15.645919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:15.646796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:15.648165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:15.649172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 218/437] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:15.649172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.652036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ee20e-6321-447f-a3ff-abf3c39a5b0b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.693871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.694521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.695742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.696029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.712488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.762271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a126-6e8b-4bfb-83f4-52ffaeec5c56 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.776703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.778193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.796287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.796951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.797237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.797513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.798345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:15.798658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.800146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.806298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 219/438] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=f6bbc40942b34b86976ba1a5b7efa0b9&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.808103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.870408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.894646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 220/439] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:15.900601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:15.936222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34b4b-e21b-4573-bdef-f1fdd2b25768 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:15.955532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:15.979800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:15.982983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.982983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.982983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.982983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:15.982983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:15.983552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9d9a-0006-49b1-b24d-ac668af27771 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:15.993866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 220/440] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:15.995341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd83f-af2d-4df1-b6ad-d09eed38ee98 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:15.995635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd83f-af2d-4df1-b6ad-d09eed38ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:15.995918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd83f-af2d-4df1-b6ad-d09eed38ee98 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:15.997441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 221/441] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:15.999728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd83f-af2d-4df1-b6ad-d09eed38ee98 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.022353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2124a-b9cf-4b33-9e5d-ab38ce0efc57 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.063640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.064500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.064774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.065039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.066304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.068605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201a1b-9f5a-4bcc-804a-07adfc621650 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.072221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 221/442] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:16.072221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.072221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.072221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.088739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:16.089926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:16.121459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd83f-af2d-4df1-b6ad-d09eed38ee98 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.140707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.161754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.162414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.162702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.165001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.171440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 222/443] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:16.172350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.219329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.249063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.250549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.283929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216deaf-83e9-40f1-ba5e-4f535c8252dc None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.326558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.328152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.328152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.328152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.330391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.331919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.334739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 223/444] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:16.334739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.364230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 222/445] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:16.365068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.381972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.434000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbccf66-0704-4eb5-9966-bb39dc0149e1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.442167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.466165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97883-cc54-4b45-8f11-900ce40f4bb8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.468292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.469115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.469455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.469636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.480119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:16.488158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:16.489083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:16.489858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:16.495086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 224/446] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:16.496157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.502221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.502872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.503180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.503461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.504271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=ad923c69cc724dfd804ae86198b268c0, scope.project.id=b3334a3d1dc545649c5fdc791825cba0) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:16.504582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.506054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.512526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 223/447] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=ad923c69cc724dfd804ae86198b268c0 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:16.513282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.626322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dcd4f-3e97-4948-967f-6d995f6a7728 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.630907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667bafd-dbbd-4e6c-b344-a376b7c75302 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.634109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.672809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.673699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.673983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.674259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] PATH_INFO: `/v3/projects/b3334a3d1dc545649c5fdc791825cba0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.676157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] RBAC: Authorizing `identity:get_project(project_id=b3334a3d1dc545649c5fdc791825cba0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.676261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.676936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.677047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.677221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.677484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.678230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:16.678538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.678991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 225/448] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/projects/b3334a3d1dc545649c5fdc791825cba0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:16.684074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.686321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.696677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 224/449] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:16.703820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.708496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.811846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93780959-3001-4e38-8d57-ab1e94320a61 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.819300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd0766-9fa2-4f28-a00e-4c88c275a68a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:16.858052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.858947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.859227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.859504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] PATH_INFO: `/v3/groups/0e4364e19642446ba7a31edd9448070b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.861219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] RBAC: Authorizing `identity:get_group(group_id=0e4364e19642446ba7a31edd9448070b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.862932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.864235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/groups/0e4364e19642446ba7a31edd9448070b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:16.870103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:16.870771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:16.870897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:16.871205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:16.871903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:16.914006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.939761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:16.941249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:16.944332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:16.971786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bae6-451d-4053-bb28-28a7a1358eaf None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:17.006698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:17.007444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:17.007727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:17.007998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:17.008830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] RBAC: Adding query filter params (group.id=0e4364e19642446ba7a31edd9448070b, role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=b3334a3d1dc545649c5fdc791825cba0) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:17.009130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:17.010550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:17.016349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 227/451] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/role_assignments?group.id=0e4364e19642446ba7a31edd9448070b&scope.project.id=b3334a3d1dc545649c5fdc791825cba0&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:17.045172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 225/452] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 20:29:17.051272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:17.159292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269709-6016-4657-b950-a1f6f1234d34 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:17.166857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:17.197916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:17.198793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:17.199101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:17.199377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] PATH_INFO: `/v3/projects/1b2e1869a6a84cb5949adf32c69b433a` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:17.200605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] RBAC: Authorizing `identity:get_project(project_id=1b2e1869a6a84cb5949adf32c69b433a)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:17.202068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:17.203807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 228/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:29:17 2022] GET /identity/v3/projects/1b2e1869a6a84cb5949adf32c69b433a => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:17.209623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:17.310649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94567d6b-30fc-43f1-af32-f2a1a414335f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:17.313063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:17.345199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:17.346057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:17.346345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:17.346623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] PATH_INFO: `/v3/groups/d80563d1bb06414691e11f20e82b7337` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:17.347857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] RBAC: Authorizing `identity:get_group(group_id=d80563d1bb06414691e11f20e82b7337)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:17.349315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552a5db-240d-4d00-b08c-87cf1b956222 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:17.351361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 226/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 13 20:29:17 2022] GET /identity/v3/groups/d80563d1bb06414691e11f20e82b7337 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:17.357309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:17.485697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ec10-865d-417b-bce7-7326a3ad51ee None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:17.524180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:17.524825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:17.525106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:17.525381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:17.526214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] RBAC: Adding query filter params (group.id=d80563d1bb06414691e11f20e82b7337, role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=1b2e1869a6a84cb5949adf32c69b433a) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:17.526524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:17.527996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189f312-62b7-4450-b621-b53888ebe8a2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:17.533747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 229/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 13 20:29:17 2022] GET /identity/v3/role_assignments?group.id=d80563d1bb06414691e11f20e82b7337&scope.project.id=1b2e1869a6a84cb5949adf32c69b433a&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:19.927961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a298-63ed-497c-9501-3e16fb09eaa4 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:19.928450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a298-63ed-497c-9501-3e16fb09eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:19.928450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1a298-63ed-497c-9501-3e16fb09eaa4 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:19.930051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 227/456] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:19.936987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad0ef-3873-4847-bb26-c18a8625637a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:19.937459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad0ef-3873-4847-bb26-c18a8625637a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:19.937536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ad0ef-3873-4847-bb26-c18a8625637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:19.965492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-282ad0ef-3873-4847-bb26-c18a8625637a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:19.966684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-282ad0ef-3873-4847-bb26-c18a8625637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:20.008276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.058883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 230/457] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:20.094725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1a298-63ed-497c-9501-3e16fb09eaa4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.105760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdca9-02a4-40ee-8fc6-6777306d1d81 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.106040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdca9-02a4-40ee-8fc6-6777306d1d81 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.106325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfdca9-02a4-40ee-8fc6-6777306d1d81 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.109668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 231/458] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:20.113051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab4a3-0342-433d-9d46-1d08c03ad6d3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.113340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab4a3-0342-433d-9d46-1d08c03ad6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.113627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab4a3-0342-433d-9d46-1d08c03ad6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.147985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-953ab4a3-0342-433d-9d46-1d08c03ad6d3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:20.149181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-953ab4a3-0342-433d-9d46-1d08c03ad6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:20.212206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1a298-63ed-497c-9501-3e16fb09eaa4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.249039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.250169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.250596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.251057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.261863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.263605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:20.285570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:20.286653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:20.287743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:20.287743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:20.287743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.287743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:20.289855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 228/459] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:20.295855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.343050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 232/460] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:20.367184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf648-7b38-4216-ac5c-d1283fc4f08c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.367694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf648-7b38-4216-ac5c-d1283fc4f08c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.368111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cf648-7b38-4216-ac5c-d1283fc4f08c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.368466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.370087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 233/461] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:20.376169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.376716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.377188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.394201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:20.395719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:20.456755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810a4e-8672-4121-a9ef-16d37928d410 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.474623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 234/462] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:20.475769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.510804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.518626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.519626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.520113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.520596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.521575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:20.522077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.523846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.538474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 229/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:20.540455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.610675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf71de-8859-4682-a1c1-e2de5c67476e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.640653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.657603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.658402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.658682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.660039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.666061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4097afa-73bc-435f-999c-4a0c902669df None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.676792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.679241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:20.702149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:20.703278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:20.704117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:20.704117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:20.704117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.704117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:20.705873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.710887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.710887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.710887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.711395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 235/464] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:20.712120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.722762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.724763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:20.748328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:20.749231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:20.750043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:20.750043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:20.750043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:20.750043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:20.754434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 230/465] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:20.755293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.812701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.833568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f31d-a53c-4c16-922c-c1072ce4b03c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.864731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0503ac-3895-4980-a90d-7d9ad28db9f3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:20.868896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.869722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.870143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.870548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.871493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.873186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.902949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379760d7-6931-48ea-a681-640a473daacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:20.902949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379760d7-6931-48ea-a681-640a473daacc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.902949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379760d7-6931-48ea-a681-640a473daacc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.902949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379760d7-6931-48ea-a681-640a473daacc None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.903374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379760d7-6931-48ea-a681-640a473daacc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:20.903374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379760d7-6931-48ea-a681-640a473daacc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:20.903374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379760d7-6931-48ea-a681-640a473daacc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:20.903538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 236/466] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:20 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:20.904420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:20.919305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:20.922802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 231/467] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:20.924479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53fdc-5891-4e66-85e3-14c257d91875 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:20.924775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53fdc-5891-4e66-85e3-14c257d91875 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:20.925184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53fdc-5891-4e66-85e3-14c257d91875 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:20.927737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 232/468] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:20.928687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53fdc-5891-4e66-85e3-14c257d91875 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.032449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604059de-b6b6-4ce9-9b21-c9ca2f46b9ce None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.075739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.076489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.076839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.077038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.077772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:21.078075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.079488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ef61-1277-4ddb-80f4-ae01d3a73dc2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.080165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53fdc-5891-4e66-85e3-14c257d91875 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.083196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:21.097088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 237/469] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:21.098488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.098777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.099214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.121176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.121850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.122180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.122343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:21.122456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.123214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.123622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:21.124661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.149363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 233/470] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:20 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:21.150439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.214861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 238/471] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:21.222784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:21.244990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.288247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5da7-ca36-4483-9cd6-7aa540089b65 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.339236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.340697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.341185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.341955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.342966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.345410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfcf54-a2b2-4e8b-aae4-291934e34efa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.384432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 234/472] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:21 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:21.404307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7e236-0b12-403a-a1af-3043e0e52cd8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.435356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efd14-6ce4-4059-83a8-94ed4c9253ef None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.435648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efd14-6ce4-4059-83a8-94ed4c9253ef None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.435773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:21.435915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5efd14-6ce4-4059-83a8-94ed4c9253ef None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.437580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 235/473] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:21.444037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.444329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.444608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.448203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.449419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.449879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.450316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.462500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.464323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.479725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:21.481349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:21.489127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:21.490043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:21.490863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:21.490863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:21.490863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:21.490863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:21.490863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 239/474] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:21.497912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.574064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 236/475] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:21.597061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.631612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6437-efab-40cb-b487-4d789f8fedae None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.652732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:21.691113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.691787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.692062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.692336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.693070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:21.693375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.694792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.716167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 240/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:21.722196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.737553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6787-8cd5-4711-8365-783bf63c163e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.776505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:21.782716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.784735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.785269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.785739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.786796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.788498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.795737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.sql.core [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 20:29:21.795737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 20:29:21.795737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [parameters: {'id': '65d4f984abf64690ae38eb0c0d9e7d3f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 20:29:21.795737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80495) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result.read() Jul 13 20:29:21.818801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return ref.to_dict() Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:29:21.819842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application yield resource Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise self.value Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application session.commit() Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 20:29:21.820878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.session.flush() Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application compat.raise_( Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 20:29:21.821702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:29:21.822547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result.read() Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:29:21.823370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [parameters: {'id': '65d4f984abf64690ae38eb0c0d9e7d3f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:21.824183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 20:29:21.825054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:21.825862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 237/477] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 13 20:29:21 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:21.840153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:21.867756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1b77-34d4-43df-977b-a0d4ffce7b02 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:21.944035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:21.945609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:21.945898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:21.946178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:21.946905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:21.948381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:21.980577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 241/478] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:21 2022] POST /identity/v3/users => generated 249 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:29:22.011738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f83669-8dec-431c-a62d-cfcecdaab41b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:22.013551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:22.058561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:22.059427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:22.059720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:22.059999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:22.072330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-03640884-2ca4-48e5-a443-93ebca0abfc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:22.081066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:22.083169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:22.085074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 238/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:22.092811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:22.235314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:22.238311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da9bf3-1001-4c22-a92c-55f35b00a7b7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:22.274021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:22.275036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:22.275499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:22.275950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:22.276918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:22.277400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:22.278995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba646c-9989-4380-a071-071b8d40d1aa None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:22.288832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 242/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:23.343309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e918-dfbb-43e8-b0f7-0f6e27378024 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.343827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e918-dfbb-43e8-b0f7-0f6e27378024 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.343901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e918-dfbb-43e8-b0f7-0f6e27378024 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.345649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 239/481] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:23.350494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.351677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.352127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.370229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:23.371741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:23.454782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 243/482] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:23.492506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e918-dfbb-43e8-b0f7-0f6e27378024 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:23.617569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e918-dfbb-43e8-b0f7-0f6e27378024 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:23.683820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:23.684973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.685457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.685903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.699941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e6642a7a-c205-4640-a651-bfde80c8b3b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:23.710016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:23.711173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:23.711936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:23.719360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 240/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:23.724906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:23.820256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:23.820988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578152b-4992-438f-b306-9cdbbb2d58f0 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.821227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578152b-4992-438f-b306-9cdbbb2d58f0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.821515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578152b-4992-438f-b306-9cdbbb2d58f0 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.830517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 241/484] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:23.830517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da880-a13f-45e7-a6c6-013b907ae36a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.830517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da880-a13f-45e7-a6c6-013b907ae36a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.830517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da880-a13f-45e7-a6c6-013b907ae36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.853943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe64c9-fa9e-4180-8c88-2b95859e3716 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:23.856293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-de8da880-a13f-45e7-a6c6-013b907ae36a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:23.857493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-de8da880-a13f-45e7-a6c6-013b907ae36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:23.894788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:23.916646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:23.917327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.917610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.917887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:23.918642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:23.918970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:23.920369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:23.947304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 244/485] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:23.952563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:23.991079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 242/486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:23.992623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bad-9cf2-4601-92b8-462f3fcd40b0 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:23.992994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bad-9cf2-4601-92b8-462f3fcd40b0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:23.993272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73bad-9cf2-4601-92b8-462f3fcd40b0 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.003636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 243/487] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:24.005840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.006305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.006731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.031871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:24.033127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:24.076174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992318-0568-4847-96a1-5701d7b6cf6a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.129501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 244/488] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:24.135093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.135093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.135093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.135093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.137254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.151320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.154835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.166715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:24.179250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.180889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.182016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:24.182016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:24.182016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.182016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:24.184430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 245/489] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.185546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.264372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.285881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ddd16-6164-4fae-9b03-a12d61a8a46f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.314080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6885c-7ed0-4d28-a54f-98133f912372 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.327773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.328700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.329080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.329456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.344060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:24.352343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.353141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.353428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:24.353541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.354543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:24.355560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:24.356308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.358295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 245/490] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.358414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.365311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:24.373523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.374847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 246/491] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.377286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.439286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.465129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f42c9c-fcfa-46af-aa71-a93cbfd7ce7c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.483522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd3651-136b-42e5-88f2-de1a5511691d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.502060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.502723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.503031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.503307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.504024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:24.504419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.506050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.525223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.525535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 246/492] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:24.525717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.525971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.526253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.526464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.527236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:24.528341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.529083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.536856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.544504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 247/493] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:24.545376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.653506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4918-0ad3-4aa7-8bc5-71394d4a46ce None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.670019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8e88-09aa-46af-9eaf-574b9581e825 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.690270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.690865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.691182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.691460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.692209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:24.692517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.693901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.696635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.702437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 247/494] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:24.703257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.714979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.716046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.716327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.716600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.724508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.726041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f5589cf3-1325-446c-b880-954aa3855815 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:24.743224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.744171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:24.745025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 248/495] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.746140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9f48-40cc-4611-b297-978e139f5e7f None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.746348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9f48-40cc-4611-b297-978e139f5e7f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.746615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9f48-40cc-4611-b297-978e139f5e7f None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.751831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 249/496] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:24.752589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab9f48-40cc-4611-b297-978e139f5e7f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.772318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:24.816407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d936b70-6881-4b36-84eb-691b90ad5017 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.855315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.856106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.856524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.856699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.860289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab9f48-40cc-4611-b297-978e139f5e7f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:24.867992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.869490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:24.889600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.890684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.891635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:24.891635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:24.891635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.891635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:24.891635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 248/497] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.891885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:24.904617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:24.905422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.906021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.906306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.921303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:24.923738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-18439384-e9e6-4c59-8226-055c35f4b21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:24.946371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:24.947268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 250/498] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:24.953608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:24.967043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:24.968242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:24.996291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.008618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8b23-46ad-4542-886c-341b281b7d0e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.026233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.050944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 251/499] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:25.050944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.056061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.056863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.057207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.057547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.058612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:25.059067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.060762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.104421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 249/500] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:25.104421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.161080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dd468-0108-45e8-9a66-6231fd6ad45a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.193641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.194302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.194626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.195025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.195742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:25.196043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.197527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.202241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da26d3-4f46-477f-a578-c973f1df2058 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.208780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 252/501] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:25.209560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.239449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.240190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.240728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.241016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.241297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.242100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:25.242406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.243843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.255881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 250/502] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:25.256689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.294667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.317824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ecd5c-0496-4369-980a-4621a30cdbb2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.350469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.351622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.351903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.352176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.360422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402885c-17cf-43c2-aea6-85a2b8e052de None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.362344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-da189894-4bd1-4b94-a871-e96a82cbd21d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:25.370203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:25.371133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:25.372092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 253/503] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:25.372986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a33f-3cc6-4939-9df3-2aba2e2c0f0b None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.372986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a33f-3cc6-4939-9df3-2aba2e2c0f0b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.373131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93a33f-3cc6-4939-9df3-2aba2e2c0f0b None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.374631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 254/504] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:25.375361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a33f-3cc6-4939-9df3-2aba2e2c0f0b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.399105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.399748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.400028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.400300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.464664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.467452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.469026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.482470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93a33f-3cc6-4939-9df3-2aba2e2c0f0b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.504487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.516776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.517574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.517850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.518119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.525314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.526857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:25.541443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:25.542365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:25.543274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 255/505] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:25.543819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.577488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 251/506] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:25.578346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.644189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76127a-cd0d-48c9-9461-3640fbbf8f47 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.680976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4d0b-c275-4c56-9d54-1fe2aa6d4a2c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.682797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.683680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.683965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.684240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.691417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.692884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-22aaf21c-67e6-45a4-aab9-160675856b19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:25.707901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:25.708993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:25.709870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:25.714212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.714975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.715175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.715266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.715462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.715563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.715738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.716217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:25.716524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.717922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.719338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.723989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.727246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 252/508] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:25.728201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.736658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:25.737846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:25.806437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 257/509] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:25.807551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.828928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5c57-168a-4a24-b9bc-003b17017518 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.863760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.864430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.864716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.864995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.865840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:25.866152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.867668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.885106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 253/510] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:25.885907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.903917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6ffd-b9df-4a5d-9424-1b3b3b335fb3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:25.937365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:25.938156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:25.938439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:25.938714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:25.940641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.947210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:25.949816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:25.951309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:25.968586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:25.969585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 258/511] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:25.970845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:25.997846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dad9-134f-4aa2-9542-cb7a54738ebf None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.032186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.032847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.033136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.033411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.034246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:26.034555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.036037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.053482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 254/512] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:26.054885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.070797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0522-1aa1-455a-98d0-457e6502390c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.105576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.106364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.106642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.106889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.117488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.118949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:26.135819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:26.136666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:26.137501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:26.137501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:26.137501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.137501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:26.137501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 259/513] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:26.137828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.161530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835a6c5-d88a-4689-b3ac-b9836eacbce8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.176204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.182358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.200362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.201157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.201443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.201725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.212378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.213873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:26.232373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:26.233222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:26.234061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:26.234061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:26.234061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.234061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:26.234061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 255/514] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:26.234315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.244730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fbe0-49e2-4e3d-a712-149124cfce2c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.282138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.282787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.283099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.283377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.332408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92f83-3951-4d9a-a47b-d9089d438e4c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.349974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.351965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.367807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.368449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.368730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.369001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.369717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:26.370018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.371447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.383764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:26.384331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.389623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.411605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.451980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 260/516] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:26.452799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.488460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb241b0-18b1-4375-a031-ffe7957f9cf4 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.521160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.521801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.522088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.522369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.548828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab955-f0cb-4ed3-b59f-2e02caeca551 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.581843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.582505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.582784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.583095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.583821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:26.584129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.585547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.587700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.589149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.592436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.597906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 261/517] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:26.598687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.617895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.697081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 257/518] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:26.697942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.708132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa46e2-324c-4c9d-b2ad-3624bd77fe97 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.741284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.741940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.742223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.742496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.743255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:26.743558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.744950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.755878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 262/519] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:26.760432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.797343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71247f92-c208-4b02-8633-8534a7e27585 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.813430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.821000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:26.831865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.832670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.832956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.833235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.840577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.842066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.855399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b23f-5d19-43a3-9a13-361a39f74154 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:26.857149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:26.857941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:26.858768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 258/520] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:26.859245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.888754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.889547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:26.889830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:26.890106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:26.900453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:26.901960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:26.918793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:26.919674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:26.920514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:26.920514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:26.920514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:26.920514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:26.920514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:26.920777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:26.965500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9921-b3cd-47d7-9b04-ad67f8228eb5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:26.999134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:26.999887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.000143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.000448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.007653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.009142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.017714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfbba-6dfb-4008-9b2d-ff5fd22c4e08 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:27.025078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:27.026122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:27.027023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.032209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.057352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.058148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.058429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.058704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.069268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.070804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.072441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:27.088390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:27.089258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:27.090094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:27.090094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:27.090094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:27.090094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:27.090094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 264/523] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:27.090489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.130194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcffd5-8c6c-4a63-99f5-b86b5238d6d5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.163754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.164415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.164697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.164968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.165663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.167161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.187254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 260/524] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:27 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:27.188068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.200711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e381-5019-48e1-b042-54c2d3321b3b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.238257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.239032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.239254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.239540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.240362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:27.240679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.242233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.267275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 265/525] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:27.268192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.298373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.306992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.309972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe85f84-6f5e-4098-950c-a4d0a2ce3040 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.350715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.351699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.352166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.352449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.353195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:27.353531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.354930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.371655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 261/526] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:27.372546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.392871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22824cf-fecf-4e2f-b440-f0a8f9d9b692 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.428469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.429366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.429750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.430145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.431063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:27.431378 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.432836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.470510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 266/527] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:27.471379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.488372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66ce4-6e75-4c2a-8ed2-10ef2ee754d0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.526546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.527549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.528003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.528537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.529369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:27.529858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.532231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.550762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 262/528] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:27.552173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.580686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.585782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.609475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926dc7-cac0-4065-8077-113948ec4b4b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.662253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.662608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.662859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.663178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.664078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:27.664388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.665909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.673832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 267/529] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:27.674737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.706039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b2b7b-3cb5-4d60-9958-146ff887ec8f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.746875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.748019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.748477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.748916 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.756703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.758658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:27.775234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:27.776138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:27.776986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:27.779531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 263/530] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:27.780618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:27.813667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7345fed-4dbe-4843-98f5-a0b4a8940acb None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.853762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462e789-b153-4f28-8253-b708887d039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.854422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e789-b153-4f28-8253-b708887d039c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.854707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e789-b153-4f28-8253-b708887d039c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.855029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462e789-b153-4f28-8253-b708887d039c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.867064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.872265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:27.899872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7df1fe-03b6-4e8e-9038-05e53faf68fa None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:27.935605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:27.936036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:27.936325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:27.936600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:27.938657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462e789-b153-4f28-8253-b708887d039c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.940454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462e789-b153-4f28-8253-b708887d039c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.944326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:27.945466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:27.960002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:27.961277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:27.962140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 264/531] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:27.962583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.070828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 268/532] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:28.071691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462e789-b153-4f28-8253-b708887d039c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.077240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c7269-a222-48f5-8fd9-ee1030ee22f2 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.112845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.113499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.113780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.114052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.114832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:28.115179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.116649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.129758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.131419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.136349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 265/533] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:28.137534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.205355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462e789-b153-4f28-8253-b708887d039c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.252074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.253100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.253870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.254241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.255405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:28.255810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.258298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.260284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01176805-7269-488a-aebc-9c1a9d16a624 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.274995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 269/534] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:28.276060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.299946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.301022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.301448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.301887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.313550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.315295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:28.334664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:28.335997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:28.337119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:28.337119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:28.337119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:28.337119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:28.339373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 266/535] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:28.340340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.402808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.406452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86b68-a86f-446d-8a97-7a55113a8e32 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.410234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.452681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.453336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.453614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.453882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.454711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=a4379a727a73403487d9a3adc342a06f) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:28.455063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.456507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.457478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543413-a913-4206-83c6-a8eda9b70343 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.462979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/role_assignments?user.id=a4379a727a73403487d9a3adc342a06f&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:28.463904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.505761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.506829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.507407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.507906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.509679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=d8d33da4251e47d8a330ef0e84ee0fdb) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:28.510269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.512928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.530566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 267/537] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/role_assignments?user.id=d8d33da4251e47d8a330ef0e84ee0fdb&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:28.582876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760fd3-c740-4bdf-a595-d9c6bc9ffcbe None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.629258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.630318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.630815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.631284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.632286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:28.632789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.634441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.653895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 271/538] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:28.659546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.799701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229723-593a-4567-8ba3-50d902a1c797 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:28.816503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.835237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:28.836111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:28.836392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:28.836666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:28.843790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:28.845266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:28.859846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:28.860702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:28.861512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 268/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:28.872168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:28.905840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:28.989982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdba42-7bc8-400d-989b-138eb17eb767 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:29.029671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:29.030392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:29.030676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:29.030967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:29.031764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:29.032070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:29.033515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c8e76-f22a-4bdb-a14f-e8d049f96f7f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:29.049814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 272/540] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:29.056081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:29.163549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cc89-609e-44e6-9985-cb5ad47d9a31 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:29.197298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:29.197968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:29.198250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:29.198530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:29.199398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=455761927d084f3893b404776f8dd9b9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:29.199709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:29.201160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f127-7819-40b2-a81b-7d5bbaf8f216 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:29.207319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 269/541] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:29 2022] GET /identity/v3/role_assignments?user.id=455761927d084f3893b404776f8dd9b9&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:29.455212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69db0-cffa-43a3-800b-7593f34d61ce None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:29.455730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69db0-cffa-43a3-800b-7593f34d61ce None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:29.455730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69db0-cffa-43a3-800b-7593f34d61ce None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:29.457409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 273/542] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:29.462900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:29.463353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:29.463519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:29.481048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:29.482244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:29.525293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:29.569485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 270/543] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:29.599561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d69db0-cffa-43a3-800b-7593f34d61ce None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:29.714310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:29.727734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d69db0-cffa-43a3-800b-7593f34d61ce None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:29.772536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:29.773468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:29.773753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:29.774031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:29.794820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:29.802555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:29.803465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:29.804298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 274/544] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:29.810311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:29.968270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091e84-291b-44b9-83f8-fb28ada9edf7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.016525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.017530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.017982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.018438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.019379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:30.019854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.021393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359e567-a1d7-44e0-bc94-dd9d4eb436af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.033596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 271/545] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:30.039101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.068827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897576e-c898-491a-ae96-41f2f2a17c6e None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.069463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897576e-c898-491a-ae96-41f2f2a17c6e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.070322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897576e-c898-491a-ae96-41f2f2a17c6e None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.072234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 272/546] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:30.077145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.077660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.077763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.094370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:30.095598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:30.143787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:30.211016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d98704-cb08-47a4-aa0e-cd606989a1d5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.220826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 273/547] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:30.264375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.265181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.265465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.265793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.269916 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.280308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.281843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.301264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:30.315247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:30.316117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:30.316941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:30.316941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:30.316941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:30.316941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:30.316941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 275/548] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:30.321948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.463657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc273b-2e0a-49fd-9936-a253135bfa02 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.489840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b802-5af9-472e-9d71-023e72981349 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.534953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.535762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.536041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.536318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.553939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.557091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.557375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.557643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.558379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:30.558680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.559899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:30.560228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:30.567626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:30.568503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:30.570506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 274/549] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:30.576132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.590606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 276/550] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:30.596988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.629366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:30.690459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:30.737733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d6cc-fb32-4f29-b283-24f40ea90e91 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.738106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db3e5-9a5d-4dd3-a79d-dfd1991dbb21 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.775027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.775027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.775027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.775388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.775905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:30.776208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.777596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.784726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.785738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.786166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.786370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 275/551] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:30.786747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.794824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.795105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.796504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:30.826347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:30.827521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:30.829330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 277/552] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:30.837384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:30.894100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:30.910809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050aed69-e075-49b5-bf7c-dba3da379e1f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:30.947575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:30.948733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:30.949227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:30.949690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:30.961831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:30.963644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:30.985645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:30.986580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:30.987792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:30.987792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:30.987792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:30.987792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:30.990305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 276/553] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:30.995645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.023140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424abc-c12c-423a-920e-859db755ad91 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.059751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.075334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.076419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.076708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.076984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.078119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:31.078438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.080109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7544-d591-435b-b18f-2bebbee0bb54 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.103201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 278/554] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:31.108031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4d6b-e7e0-42ff-b42a-5f872dc3c039 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.108031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4d6b-e7e0-42ff-b42a-5f872dc3c039 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.108031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4d6b-e7e0-42ff-b42a-5f872dc3c039 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.110726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 279/555] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:31.111538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4d6b-e7e0-42ff-b42a-5f872dc3c039 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.148459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc6d5-ee9c-43f8-ad68-8ceb259f9439 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.189570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.190657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.191191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.191905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.193074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:31.193523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.195503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e842e-a379-4509-a146-413379fc7b73 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.199446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.212732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 277/556] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:31.214390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.214945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.215237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.237998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:31.239220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:31.241708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4d6b-e7e0-42ff-b42a-5f872dc3c039 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.281121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.282251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.282732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.283223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.305389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 278/557] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:31.306238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.341271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.365069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.366550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004b622-e63b-4d49-8304-1e76f6aeac12 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.424861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713005-eb3a-4e0f-baeb-cdb777570a11 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.451682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.461324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.462120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.462412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.462667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.470289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.471830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.476959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 280/558] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:31.476959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc075f-787c-448c-804d-cb67a9dcfd13 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.476959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc075f-787c-448c-804d-cb67a9dcfd13 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.476959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc075f-787c-448c-804d-cb67a9dcfd13 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.476959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 281/559] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:31.477798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc075f-787c-448c-804d-cb67a9dcfd13 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:31.492933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:31.493911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:31.494853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:31.497450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 279/560] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:31.498444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.561743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.583691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc075f-787c-448c-804d-cb67a9dcfd13 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.604021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea043-53f0-42ef-97f5-5a7cd7ef5e48 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.617966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.618761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.619061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.619328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.629640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-96278ac4-6b75-41ab-a495-c8f89a0fc69d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:31.637436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:31.638503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:31.640327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:31.641008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.641008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.641008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.641212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 282/561] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:31.641289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.641358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718042b6-3d3c-4507-a260-a10fa6a0abad None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.641358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718042b6-3d3c-4507-a260-a10fa6a0abad None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.641358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718042b6-3d3c-4507-a260-a10fa6a0abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.655262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.657572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.659762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-718042b6-3d3c-4507-a260-a10fa6a0abad None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:31.661555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-718042b6-3d3c-4507-a260-a10fa6a0abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:31.685179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:31.686225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:31.687588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:31.687588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:31.687588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:31.687588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:31.687588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 280/562] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:31.688090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.730981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.742907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 283/563] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:31.744255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e5e5-b844-4c16-8e34-3eebe6f0f8a1 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.744541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e5e5-b844-4c16-8e34-3eebe6f0f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.744813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e5e5-b844-4c16-8e34-3eebe6f0f8a1 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.746105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 284/564] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:31.746772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5e5e5-b844-4c16-8e34-3eebe6f0f8a1 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.799561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977004d0-39ad-41a2-804e-b29681bbc03d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.828122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.837166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.837847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.838134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.838413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.839297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:31.839607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.841083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.861216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 281/565] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:31.862092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:31.862974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5e5e5-b844-4c16-8e34-3eebe6f0f8a1 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.899816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:31.900485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.900769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.901043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.901790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:31.902094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:31.903516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b364-6e30-40dc-82bb-242a9460927f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:31.911862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 285/566] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:31.913078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:31.913361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:31.913659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:31.929822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:31.931031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:31.958722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:31.966004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1c2e-ec0b-4b7e-bbd2-1c5c16dd4e31 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:31.999890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 286/567] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:32.000744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.010674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.011382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.011671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.011955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.012721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.013029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.014439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.026443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 282/568] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.027288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.069125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.116509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3503ab5-0ada-46b5-8e9d-18f7421a30dd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.127472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9caa13-480e-4ea1-ab9b-d546cbb049a9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.156946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.157743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.158022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.158294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.160913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.161700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.161987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.162265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.168766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:32.172674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.174143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:32.176412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.177384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:32.178248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 287/569] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.178956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:32.194222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.195368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 283/570] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.196423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.209665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.292548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcdb0e-fd61-40bb-bd53-73ef9f0d5b3d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.300010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ad78-f52c-4258-b093-0f0bfd49ba67 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.313132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.327312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.328161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.328448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.328773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.334026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.334811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.335128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.335506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.339457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.340945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.345422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:32.353971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.355123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:32.356153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 284/571] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.356897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:32.358178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.359154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 288/572] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.361224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.426037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.460121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125f96-9ab4-41cf-9576-2ae16e19b509 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.460355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032b7a9-83b5-44d8-aff2-5f974843037b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.493886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.494393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.494673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.494984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.495104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.495258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.495348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.495607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.496359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.496666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.498047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.501777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.503398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.506285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 289/573] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.507105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:32.517302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.518168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:32.519333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 285/574] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.520014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.541959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.606735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c00a9d-5284-4341-8979-70bda78d4a37 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.617591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8784bf-5e02-4ad2-bd8b-729bc96fbd88 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.640368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.640835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.641142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.641417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.642138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.642459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.643272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.644194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.656046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 290/575] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.656354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.656981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.657421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.657724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.657998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.658748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.659390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.660486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.670603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 286/576] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.671478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.754836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.762190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def30f-a62d-46cd-8bd6-11902294f27e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.773205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e11e-ea4a-4a7b-b462-be0f963631af None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.795797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.796459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.796741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.797018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.797743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.798048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.799488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.807457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.808248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.808812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.811376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 291/577] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.812093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.824376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.825851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:32.843858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:32.844894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:32.845776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:32.845776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:32.845776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:32.845776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:32.845776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 287/578] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:32.846048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.889075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.916267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51bbc3-ef11-4994-b3e4-b3388d22bbf7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.948577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0a78-b6bd-4473-a4fe-1695d7e32992 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:32.948996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.949662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.949947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.950225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:32.951043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:32.951351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:32.952793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:32.964709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 292/579] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:32.965526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:32.980613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:32.992484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:32.993273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:32.993554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:32.993821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.000611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.002066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:33.015900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:33.016768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:33.017637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 288/580] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:33.018109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.078802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3261-adb1-4ff2-ac30-f5269cbb31ef None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.113638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.114434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.114717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.115017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.118527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14cdde-c8c6-41aa-8428-11c4ce47abf5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.120089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.125123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.126558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:33.144499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:33.145555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 293/581] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:33.146644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.157035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.157811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.158090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.158363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.166386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.167853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:33.182085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:33.183066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:33.184009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 289/582] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:33.184801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.219425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.256272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966ecb-454a-475a-8fc3-b88b39110fda None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.285348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b63f-43e2-431c-8985-8560b0929941 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.290035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.290693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.291001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.291272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.291993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:33.292293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.293655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.311105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 294/583] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:33.311105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.323059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.323719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.324003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.324276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.325130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=588e6f0b3d6a452ea8a197cc6930dc60) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:33.325443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.326886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.332198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 290/584] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/role_assignments?user.id=588e6f0b3d6a452ea8a197cc6930dc60&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:33.333040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.365462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.432743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318269-778c-447a-bde8-adb25cadb5fb None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.456414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2df2-1c9c-4cb4-ab0f-23db254bc22f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.474957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.486344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.487047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.487343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.487621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.488515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:33.488721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.490183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.500412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.502256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.502256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.502449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.503114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:33.508925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.509076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 295/585] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:33.509076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.509226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.517463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 291/586] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:33.518304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.609721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.619194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0b128-6b52-4c75-9991-827b43240e27 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.626203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9a5ca-f994-4e66-aeb8-517c239edd54 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.654853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.655552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.655829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.656124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.656960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:33.658817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.658817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.671216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.672024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.672366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.672829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.684332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 296/587] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:33.684332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.686367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.687879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:33.703466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:33.704496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 292/588] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:33.705432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.739676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:33.806336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05647b4d-4af2-4359-9d1b-bf6518f86646 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.815440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653db7c-15b5-4af7-b26f-3b4236dea94f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:33.843428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.844313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.844589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.844858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.850570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:33.852465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:33.852747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:33.853033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:33.860499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.860850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=8eebb29015984c98a0c6867dcb03fd71, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:33.861890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.862390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:33.882969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 297/589] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:33 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:33.882969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:33.883303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:33.884290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 293/590] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:33.885220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:33.890206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.004763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f6e9-52d2-4dd7-b438-4d5ee485dbfc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.029188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.041768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e47b82-40ad-4a65-bf6c-06fc16b73de1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.053334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.054200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.054895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.055205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.056223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.056580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.058222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.077863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 294/591] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:34.078964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.085511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.087026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.087319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.087597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.104251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.106381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:34.130130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:34.131227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:34.132184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:34.132184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:34.132184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.132184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:34.132184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 298/592] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:34.132784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.158330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.204161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2469f2c-9da6-44d8-b9d0-c7d31c9bdd5c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.240757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.241433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.241774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.242052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.242898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.243360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.244812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.255936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284d310-cafc-4b29-8d2f-3e9c5f80976e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.263458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 295/593] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:34.264504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.295085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.296892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.297646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.298113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.314747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.316254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.326506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:34.339615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:34.340528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:34.341388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:34.341388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:34.341388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.341388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:34.345353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 299/594] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:34.346545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.395175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b84f5-6bd5-4827-ab27-c99a22558aa4 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.428666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.445953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.447705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.448464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.448914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.450113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.450618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.452836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.459604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb4860-c90c-4c62-aeb0-bd592b094562 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.470602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 296/595] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:34.472106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.497774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.498944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.499316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.499587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.510873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.512496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:34.530312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:34.531418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:34.532298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:34.532298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:34.532298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:34.532298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:34.533097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 300/596] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:34.533941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.583412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.585543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204814d3-f7f1-471b-81e6-cb5329b9e6bf None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.623557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.624587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.625178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.625723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.626636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.627169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.628924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.634411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1cc9-010a-4d82-8850-8aa909d5eeb3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.642624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 297/597] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:34.643767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.669246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.670233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.670410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.670633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.677983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.679643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:34.694946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:34.695820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:34.696761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 301/598] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:34.697228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.703561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.765888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd411ec-2a52-4439-aa41-06c94e2a9983 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.802339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.803428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.803933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.804511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.805426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.805921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.807767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.819074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e3f6-af21-40a7-b4db-2277f724de05 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.821298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 298/599] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:34.822382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.830526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.858141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.859126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.859408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.859678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.868339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.870292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:34.888245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:34.889149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:34.890006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 302/600] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:34.890982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:34.936838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ebe7-9351-40fd-8c7b-1971044c65ba None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:34.938730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:34.981991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:34.983275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:34.983626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:34.983966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:34.985259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:34.985637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:34.987524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.004844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 299/601] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:35.006280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.008692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d77f-d5cb-4037-bf24-f1dbd32d54d7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.046413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.047238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.047524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.047798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.054767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.056430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:35.071562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:35.072507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:35.073382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:35.077465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 303/602] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:35.078182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.110508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.131315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00badc-09a6-46e0-912d-1151702d90fa None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.173568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.174236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.174523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.174800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.175726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:35.176041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.177503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.187486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924d81-7936-468a-bd5e-2f26c8747635 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.191534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 300/603] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:35.192375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.223236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.223922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.224128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.224408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.225057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/a4379a727a73403487d9a3adc342a06f/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.241009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=a4379a727a73403487d9a3adc342a06f, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.242541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.257435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 304/604] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:35 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/a4379a727a73403487d9a3adc342a06f/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:35.258872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.309769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c076-3264-4e69-a769-188115d19191 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.350323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.352763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.353240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.354472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.355006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.356095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:35.356614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.359004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.375252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 301/605] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:35.384671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.393394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686a44-2ca2-402c-9151-2a11ddc476cc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.435567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.436468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.436742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.437012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/d8d33da4251e47d8a330ef0e84ee0fdb/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.459683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=d8d33da4251e47d8a330ef0e84ee0fdb, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.461368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6631aa-d97d-4e6c-b636-5c48496570ea None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.487727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 305/606] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:35 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/d8d33da4251e47d8a330ef0e84ee0fdb/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:35.489453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de3b-c728-4429-8ceb-8d8f1b16a4a3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.490203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de3b-c728-4429-8ceb-8d8f1b16a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.490492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17de3b-c728-4429-8ceb-8d8f1b16a4a3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.493654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 306/607] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:35.498177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.498867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.499198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.499554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.520523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:35.521172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f019d-be9c-4c8a-8bf7-9f4d9f20883d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.521738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:35.569479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.570779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.571097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.571377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/455761927d084f3893b404776f8dd9b9/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.588947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=455761927d084f3893b404776f8dd9b9, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.590475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:35.613241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 307/608] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:35.613913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 302/609] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:35 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/455761927d084f3893b404776f8dd9b9/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:35.637040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.706931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.753881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bd617-c879-4664-badc-c044a7498865 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.791443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.792266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.792550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.792824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.805198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:35.813251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:35.814316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:35.815170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 308/610] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:35.821068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:35.943153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224041-5a97-4601-b9ba-583b3dfb8017 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:35.981020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:35.986633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:35.987784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:35.988311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:35.989092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:35.990048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:35.990535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:35.992384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:36.003330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 303/611] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:36.008708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.154629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9455e6-55b4-4211-ab21-bf9e89005677 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:36.178110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:36.198196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:36.199084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.199362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.199630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.211502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:36.212965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c8b5dbc7-77c2-4a2c-a4db-93169077107c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:36.237191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:36.238139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:36.239044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:36.239044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:36.239044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:36.239044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:36.239044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 309/612] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:36.244339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.281301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06865-87a6-4285-8a72-e683ca364c81 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.281476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06865-87a6-4285-8a72-e683ca364c81 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.281756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06865-87a6-4285-8a72-e683ca364c81 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.283148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 310/613] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:36.290553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.290842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.291255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.310526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:36.311773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:36.395196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 311/614] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:36.413744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.437695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10444c0-0961-4fb4-91f6-7ae2e46c8d9f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:36.521263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322d5a-1445-4a37-a2ac-c23d8901c4c3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:36.543393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:36.557717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:36.558528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.558817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.559670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.563603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:36.564329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.564618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.564895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.565628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:36.565935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:36.567418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:36.581535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:36.590124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 304/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:36.596201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:36.599544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:36.600451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:36.601619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:36.604816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 312/616] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:36.607879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.688572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:36.766768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9652f-56d0-489f-a31c-7309a4a32e8b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:36.847773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9cbf-119c-41b7-a01a-d7be91efa85f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:36.852826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:36.854031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.855368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.855844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.869832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:36.872775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:36.902115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:36.903112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:36.904037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:36.908956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 305/617] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:36.915529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:36.922737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:36.923300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:36.923577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:36.923847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:36.924600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:36.924903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:36.926318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:36.944591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 313/618] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:36.950492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.011480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.029753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661014-cb15-4e82-a530-16edaaa68638 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.044501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.069807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.070885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.073981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.074779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.076376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:37.077358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.080536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.102377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 306/619] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:37.112374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.149946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2246db-c242-4ff2-9bc5-39421e84e745 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.200581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.201667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.202092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.202528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.223126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.224879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:37.262356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:37.263516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:37.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:37.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:37.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:37.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:37.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 314/620] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:37.268374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3d4f-a311-42fd-92f0-bf1aec0110d1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.279244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.318533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.319471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.319729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.320512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.331074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.332645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:37.352102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:37.353135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:37.354072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:37.354072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:37.354072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:37.354072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:37.354072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 307/621] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:37.363986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.395937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.404575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.424618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afdf19-3814-44e9-bd81-15cb262fde11 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.471107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.472247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.472733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.473241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.474223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:37.474741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.477202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.504920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 315/622] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:37.512554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5be8-20ef-4605-8b30-aaeb0ef4d71a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.524305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.599678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.600374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.600632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.600972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.602373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:37.602373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.603930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.635432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 308/623] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:37.636209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.644655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05709c-a943-4a77-adf2-2bbcb5d6c830 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.691629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.692432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.692714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.692991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.704565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.716241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.719200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4f6668f2-19b2-4259-a97b-8ff16c765465 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:37.748292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:37.749330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:37.750297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:37.763210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 316/624] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:37.766053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32229f-7f91-487f-8475-9a7ccb7972bd None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.766340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32229f-7f91-487f-8475-9a7ccb7972bd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.766619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32229f-7f91-487f-8475-9a7ccb7972bd None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.768286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 317/625] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:37.768977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32229f-7f91-487f-8475-9a7ccb7972bd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.789676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:37.808043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedd017-d1c1-499f-a615-5a3f6f7ecdfd None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.847385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.848560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.849112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.849599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.857671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.859488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3a5f9e8f-a08c-4c7e-bc04-a690bb1f6a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:37.873867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:37.874802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:37.875730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:37.878217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 309/626] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:37.879762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c22b7-9fbb-41fb-815f-305ba6b3ef98 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.880247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c22b7-9fbb-41fb-815f-305ba6b3ef98 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.880733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c22b7-9fbb-41fb-815f-305ba6b3ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.899201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ff1c22b7-9fbb-41fb-815f-305ba6b3ef98 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:37.900733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ff1c22b7-9fbb-41fb-815f-305ba6b3ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:37.903486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32229f-7f91-487f-8475-9a7ccb7972bd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:37.950379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:37.951199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.951515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.951797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.952658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:37.952969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:37.954407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:37.977475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 318/627] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:37.978308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:37.985793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 310/628] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:37.987416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30486-d606-47ca-a076-059cd3e01615 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:37.988460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30486-d606-47ca-a076-059cd3e01615 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:37.988949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30486-d606-47ca-a076-059cd3e01615 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:37.991117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 311/629] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:37.992728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30486-d606-47ca-a076-059cd3e01615 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.043958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.075373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.092267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac593f8-9f01-47b0-8410-d3452700b54e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.101900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30486-d606-47ca-a076-059cd3e01615 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.129040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.129643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.129902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.130250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.130983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:38.131295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.132758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac22e8c-9599-4f34-9714-23969d95ab90 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.137380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.138028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.138310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.138582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.144877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 319/630] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:38.145943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.146227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.146498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.163817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:38.165002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:38.211464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.212926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.228682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 320/631] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:38.229303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.273040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.285883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.310892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 312/632] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:38.311795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.327045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0282-6942-4ea1-81af-87c39400e2a2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.360196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.360988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.361269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.361531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.371763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5119753a-e450-432c-868b-d2c3af0715c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:38.379388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:38.380390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:38.381265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 321/633] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:38.382141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cadec-161b-4c5c-9f13-4e4671b44620 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.382141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cadec-161b-4c5c-9f13-4e4671b44620 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.382348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cadec-161b-4c5c-9f13-4e4671b44620 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.383930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 322/634] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:38.384627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cadec-161b-4c5c-9f13-4e4671b44620 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.415543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3c37e-1acd-4c98-a4ad-8a4d38a68be8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.448582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.449446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.449721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.449991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/588e6f0b3d6a452ea8a197cc6930dc60/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.463974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=588e6f0b3d6a452ea8a197cc6930dc60, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.465463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.478759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 313/635] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:38 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/588e6f0b3d6a452ea8a197cc6930dc60/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:38.479580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.496873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cadec-161b-4c5c-9f13-4e4671b44620 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.499633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.508042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.536528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.537342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.537620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.537890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.549648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:38.557914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:38.558977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:38.559930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:38.564120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 323/636] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:38.565093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.597633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bedc4-c33e-4c5a-b630-054fb88cd11a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.641619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.643132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.643416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.643737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.657215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.657215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.674406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a945-22cd-4eb6-9a7d-e5142bf31d12 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-7f0b5a40-72b9-4285-82eb-c7841fdff876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:38.677627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:38.678505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 314/637] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.684251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.701127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:38.702491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:38.711162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.711835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.712119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.712398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.713146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:38.713455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.714831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.723022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 324/638] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:38.723815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.755957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.776208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 315/639] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:38.787858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.798603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.834686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e70f0b-a7fc-4d05-8ef8-6007d5b78055 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.870226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.870887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.871185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.871454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.872206 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:38.872507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.873863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.882095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 325/640] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:38.882961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.909931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201dfd-ff9d-4cfe-9688-18905e71d006 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:38.947689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:38.948746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:38.949165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:38.949443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:38.950168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:38.950473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:38.951865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:38.968529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 316/641] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:38.968529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:38.980040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:38.993729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670715-8195-4c32-b621-7e8404eaa399 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.028271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.029318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.029598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.029873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.036134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.041126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.042619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:39.059762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.060641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.061502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:39.061502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:39.061502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.061502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:39.066491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 326/642] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.067111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.074901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1f73-b425-4977-936a-69c0b13ae294 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.109335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.110135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.110417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.110691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.121771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:39.129456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.130415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:39.131274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 317/643] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.131949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.178036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04a3ce-6696-40b5-9e63-e9be9c7dd639 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.212824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.213666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.213950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.214215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.224355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.227530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.229662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.238149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c069-f9e1-4c6a-88da-7bb16ea83232 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:39.249874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.250748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.251762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:39.251762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:39.251762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.251762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:39.251762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 327/644] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.252130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.269396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.278104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.278902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.279209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.279479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.286227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.287693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:39.302505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:39.304782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:39.308725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 318/645] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.309740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.363467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e94c4-01bd-48c3-8668-eab60bcc7e4f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.402848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.403535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.403812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.404089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.404792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:39.405259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.406446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.411188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe06de-2a40-4131-9685-511b5fb73a86 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.418118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 328/646] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:39.418924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.447748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.448418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.448698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.448971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.449713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:39.450020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.451432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.459462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 319/647] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:39.460259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.481057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.512431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.534028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76268699-fa49-481f-afdc-bfa37f651698 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.568459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.569308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c790-01e8-47d2-8b02-b9804ae3fc57 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.569786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.570263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.570812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.571790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:39.572256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.573704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.586815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 329/648] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:39.587710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.612604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.613299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.613589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.613868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.614664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:39.615012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.616460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.629291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 320/649] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:39.630094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.705440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338dd07-c50f-4c18-a658-6404f1db2cf7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.718138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.742673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93f2a-9195-4672-8123-9e0f58782195 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.743227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.744143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.744612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.745070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.753527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.754538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:39.755687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:39.771211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.772187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:39.773197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 330/650] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.773994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.785595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.786398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.786662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.786954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.797027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.798474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:39.816252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.817166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.818045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:39.818045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:39.818045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:39.818045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:39.818045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 321/651] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.819162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.889292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb99a11-6895-4f3a-b05e-0d1ffc6b5ffc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.926652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.927613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.927894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.928164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.929986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93bfb2-c398-4be9-a0f5-f04a22c17b42 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:39.936234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.938008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:39.953355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:39.954489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 20:29:39.955714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:39.962470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 331/652] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:39.963425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:39.963659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:39.964090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:39.964375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:39.964661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:39.965495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:39.965811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:39.967288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:39.973232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 322/653] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:39.974014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.010463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.011098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.110151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05244ba-f5cb-407d-a5bd-d0eaebfb8b6a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.114045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e77d6-1e96-48a9-884e-d0adac0ee18f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.151438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.151438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.151859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.151979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.152758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:40.153074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.154626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.177642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.178016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 332/654] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:40.178871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.179271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.180446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.181031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.182434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:40.182999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.185042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.205867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 323/655] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:40.205867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.308828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.316425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.324866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284a7-fa62-468a-8833-bcc9af4bfcee None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.334331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106ad8d-d3ca-4b24-b29e-fd248ab7d041 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.371018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.372079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.372538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.372765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.373218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.373470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.373758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.374030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.374867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:40.375380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.377274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.405708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 333/656] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:40.407054 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.459142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.461877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.519013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318847-9142-4b6a-b770-4e29ebe426b2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.555814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.556594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.556905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.557173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.562836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.564832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.566346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.586973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 324/657] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-d790784e-a50f-47ab-b8a8-946af7c96930 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:40.587167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:40.588043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 20:29:40.588967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:40.589512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 334/658] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867dd-75f9-4c72-8a18-b15b11181bf5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867dd-75f9-4c72-8a18-b15b11181bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867dd-75f9-4c72-8a18-b15b11181bf5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 335/659] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:40.589581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394867dd-75f9-4c72-8a18-b15b11181bf5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.602132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.707554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394867dd-75f9-4c72-8a18-b15b11181bf5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.707890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058672c0-0555-49c2-9e9e-06545c04607d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.743841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.744479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.744837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.745120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.746166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.746989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.747276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.747547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.758846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.760348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:40.780193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:40.781146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:40.782028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:40.782028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:40.782028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:40.782028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:40.782028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 336/660] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:40.783649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:40.804749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.822566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.824088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6be54-8a5a-42e5-9fc8-a806aeb284b9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.852375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:40.897068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f3589-a2b9-42bc-b441-9db4ba41461d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:40.927216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 325/661] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:40.933152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.933503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.933847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.934836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:40.935533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:40.935816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:40.936090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:40.936924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:40.937235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:40.938664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:40.950302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:40.951512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:40.957003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 337/662] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:40.957651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.023903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 326/663] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:41.024479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.039435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.078281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfcd82-2b38-4e5d-ab95-e4d3412e7dfa None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.095821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.116400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.117477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.117760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.118033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.118755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:41.119101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.120473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.131741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af265-3c3b-442e-ab20-25803992f62c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.136793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 338/664] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:41.136793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.167097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.168208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.168680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.169192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.180196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.181891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:41.201604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:41.202653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:41.203727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:41.203727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:41.203727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:41.203727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:41.205233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 327/665] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:41.206145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.247668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146507f-99ab-44bd-9204-02a4f2b6dda7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.272400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.286036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.286721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.287034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.287330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.308796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e40a9-37b2-455c-89bf-cadd9ef56c67 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.336216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.343421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.344461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.344839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.345018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.355820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:41.359941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.361398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:41.363334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:41.364245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:41.365091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 328/666] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:41.365784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.466207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 339/667] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:41.467032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67004-12d2-4f96-836c-e8d24db63fc1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.467147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.493685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.503440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.504296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.504579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.504906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.511715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.513171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:41.528200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:41.529077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:41.529962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 329/668] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:41.531173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.556682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.579473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e49ca-5879-45e6-af41-5af343d5a1eb None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.615433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.616092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.616376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.616683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.617412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:41.617705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.619141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.631955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 340/669] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:41.632823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.641237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c6ace-483d-4932-a61e-b67faffc6708 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.679987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.680776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.680938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.681218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.681970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:41.682280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.683812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.696622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 330/670] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:41.696622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.744595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671eba9-7070-46a3-9537-68f95dcd9cb3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.754652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.783815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.784617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.784901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.785173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.792381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:41.797819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.800096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.810212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bff88-37ce-44d3-b38f-4a607172a800 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:41.818382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:41.819513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:41.820424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:41.820424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:41.820424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:41.820424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:41.820424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 341/671] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:41.820709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.853449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.854425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.854840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.855265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.856209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:41.856531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.858540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.874136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 331/672] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:41.875005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:41.933999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4ec11-ffeb-4b2f-81ff-5e28c1906b7d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.970131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:41.970935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:41.971216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:41.971509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:41.979248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:41.980457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56114ee5-ad13-4219-89e1-7fa593ad1294 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:41.980689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:41.990526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:42.000271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:42.001217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 342/673] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:42.002816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.021841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.022635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.022984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.023410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.034391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.035870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:42.053277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:42.054869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 332/674] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:42.056172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.065239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.123707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c980f7c-68ec-4997-9507-e2bafc0ea586 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.159866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.160522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.160734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a01bfb-c3af-42f8-b78b-66aa8389dd97 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.160857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.161061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.161783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.162084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.163574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.175341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 343/675] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.176194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.196487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.197133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.197414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.197688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.198510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=d8d33da4251e47d8a330ef0e84ee0fdb) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.198819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.200294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.206369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 333/676] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/role_assignments?user.id=d8d33da4251e47d8a330ef0e84ee0fdb&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.207213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.236192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.286482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f51dc-fb8d-4564-8701-4409cc898999 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.299037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.324788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86ca2-e881-4e90-9373-8df0b911cf00 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.327302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.328958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.329314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.329662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.330542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.330945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.332480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9d9a-aca9-444d-9a10-d5bf3b6b2455 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.353091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 344/677] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.353091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e85e-deb8-430c-8cfb-3d8f3f748de2 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.353091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e85e-deb8-430c-8cfb-3d8f3f748de2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.353091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e85e-deb8-430c-8cfb-3d8f3f748de2 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.353091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 345/678] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:42.355753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e85e-deb8-430c-8cfb-3d8f3f748de2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.371156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.371831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.372120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.372490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.373489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.373489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.374955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.388589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 334/679] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.390454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.473555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e85e-deb8-430c-8cfb-3d8f3f748de2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.482710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.501690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778809af-0092-4322-9ccf-b4a4b217d80f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.509741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.510711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.511125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.511506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.518537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.520147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-17cf116e-5cfe-4094-9ee7-2184223be5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:42.534943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:42.536050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:42.537196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 346/680] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:42.538055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.538353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.538687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.543224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.543890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.544174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.544670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.546429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=a4379a727a73403487d9a3adc342a06f) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.546750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.548245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.563336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 335/681] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/role_assignments?user.id=a4379a727a73403487d9a3adc342a06f&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.563537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:42.563641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.563732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:42.586718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.650803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 347/682] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:42.651745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.705923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84e03-b0f7-4cf4-bc3d-edb9fe13138d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.751693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.752841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.753963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.754387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.763359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.765500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.780682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a95f-b7db-44bf-9068-41112f8adbdf None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:42.780956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:42.781913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:42.782837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 336/683] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:42.783952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.797954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.836628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.837656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.837902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.838183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.839038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:42.839327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:42.841558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:42.855864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 348/684] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:42.856714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:42.883189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:42.917883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aba2d4-ac4f-4b4a-8528-0a92729bbec3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.962387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:42.963218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:42.964059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:42.964345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:42.979570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4283d67-e951-4a4d-8753-60f4f3f28375 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:42.985277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:42.995307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:42.996259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:42.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:43.005170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 337/685] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:43.005170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.023703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.024537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.025069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.025441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.026458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:43.026824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.028421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.046725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 349/686] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:43.047877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.080014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.119476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04552be-b065-49c3-81c8-32cde5696f7f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.129305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.151613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd54cf-5d60-4eec-a379-34698c1dfe4f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.159805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.160657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.161092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.161553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.162633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=455761927d084f3893b404776f8dd9b9) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:43.162994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.164554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.171632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 338/687] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/role_assignments?user.id=455761927d084f3893b404776f8dd9b9&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:43.172440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.189292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.189971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.190254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.190528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.191313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:43.191619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.193025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.202953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 350/688] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:43.214139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.380021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112893d4-84e0-4bbc-92df-7ed3eb980ba8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.393609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4260-aabf-48cb-8253-a1411a72ca67 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.415848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.426381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.427058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.427455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.427757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.439158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.440697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.441210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.442024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.454264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.459176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.461873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:43.485066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:43.485998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:43.486889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:43.486889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:43.486889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:43.486889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:43.492886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 351/689] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:43.495272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.517004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.518909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.599093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391ff1-a4fb-45db-adec-369e2b4bfad0 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.625579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 339/690] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:43.634893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.638955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.639621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.639906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.640183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.640918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:43.641226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.642651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.656590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 352/691] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:43.664185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.672652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.754818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:43.806105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263b91c-6fdd-49ff-aae2-2c452fea7e41 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.857518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ddd36-7f64-4204-be88-92233c305555 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:43.887490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.888234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.888523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.888812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.902230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:43.903393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:43.903889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:43.904362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:43.911070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.912478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:43.912614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.914485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:43.929723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:43.930805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:43.932074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:43.934501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 353/692] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:43.940225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:43.960883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:43.961840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:43.962726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:43.962726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:43.962726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:43.962726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:43.962726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 340/693] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:43.968621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.046705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d2340-b350-4c63-a33a-0bf008b5c6c4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.061532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.077192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.083166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.083901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.084328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.084696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.085796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:44.086228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.087863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.097063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ce8c8-37c3-457c-b374-c84ec9d6be94 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.106531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 354/694] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:44.112025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.134056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.135092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.135600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.136016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.136873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:44.137327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.139141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.156811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 341/695] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:44.158360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.216111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265c60a-9a05-4262-845f-d60166acaf1a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.252254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.253062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.253474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.254141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.267348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada283-fa79-4e23-b361-a34ea5504169 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.294361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.305210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.306343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.306836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.307351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.324305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.326098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:44.346589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:44.347584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:44.348463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:44.364112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.365882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.367018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 342/696] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:44.371893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.382328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.483547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd1d5-45b4-4aae-9792-e6dc80a1ad6c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.519090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.520124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.520611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.521107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.522100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:44.522628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.524340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.537629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 343/697] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:44.544354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.595727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 355/698] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:44.600747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.611696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.652998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3823-f264-46fc-8d6f-a1140f54849c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.692586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.693655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.694212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.694712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.695778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=588e6f0b3d6a452ea8a197cc6930dc60) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:44.696510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.698205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f28ca-d738-48d7-9af5-a210725c27a1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.705238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 344/699] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/role_assignments?user.id=588e6f0b3d6a452ea8a197cc6930dc60&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:44.706807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977345a-c932-4ebd-aabe-69937c8a6825 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.707313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977345a-c932-4ebd-aabe-69937c8a6825 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.707799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977345a-c932-4ebd-aabe-69937c8a6825 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.709535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 345/700] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:44.719006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.719006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.719006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.720445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:44.735406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:44.736525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:44.782812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dfdb-e5ae-48fa-ae26-ae9078573a8e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:44.838823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 346/701] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:44.858786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:44.859617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:44.859900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:44.860177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:44.878494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.898094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:44.899327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:44.926145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:44.927106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:44.928605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:44.928605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:44.928605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:44.928605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:44.928605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 356/702] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:44.932827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:44.953202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.004652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92e14-46d6-4828-91d4-b73fc8e1a016 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.047601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.048056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.048160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.048441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.051324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.051324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.062623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7672-17ad-4058-9d20-c28f9b43f520 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-99ec76c0-2f01-4101-8824-f15a6d5035bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:45.067658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:45.068619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:45.069485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 347/703] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:45.070885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d562a-d296-4927-9993-e0bc3ea4b4ac None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.070885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d562a-d296-4927-9993-e0bc3ea4b4ac None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.071125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d562a-d296-4927-9993-e0bc3ea4b4ac None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.072682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 348/704] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:45.077958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.078245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.078532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.090388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.102762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:45.104046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:45.106471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.107681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.107681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.107681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.109283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.109283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.110050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.123572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 357/705] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.124452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.177001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 349/706] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:45.177923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.235543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.250866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ae79-f79a-4a1f-9f60-20d4ecf59ca1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.297093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.297685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.297808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b2b21-d46b-4d17-9b5b-5834ed27152d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.297970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.298245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.299007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.299577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.301889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.307941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 358/707] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.308762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.339981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.341142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.341486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.342082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.352135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.353963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.367817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:45.374333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:45.375342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:45.376220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:45.378997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 350/708] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:45.380012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.438070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016cf8-327a-48c7-b9a0-5b5639435849 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.477932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.478963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.479257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.479542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.495152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.497335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.502401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b862c0-c67a-444c-83c6-0c0a4f6433c4 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.517259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:45.520632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:45.521520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:45.522437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:45.522437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:45.522437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:45.522437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:45.527389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 359/709] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:45.529173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.548129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.549261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.549804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.550275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.551241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.551750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.553559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.560462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 351/710] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.561660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.673950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.678265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2ee6f-d898-4c8e-beda-ba2890ab8aa4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.716466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.717124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.717407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.717680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.718479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.718784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.720287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea22ab-85e2-46c7-9b81-dded842a3fa6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.733206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e59e-387b-4bb5-af83-e78304afb8ae None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.734168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 360/711] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.735545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f21-8738-4467-a15b-7e7deed4abb7 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.735830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f21-8738-4467-a15b-7e7deed4abb7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.736103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b3f21-8738-4467-a15b-7e7deed4abb7 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.737494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 361/712] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:45.742063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b3f21-8738-4467-a15b-7e7deed4abb7 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.780768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.782103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.782103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.782103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.782707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.783059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.784453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8b811-e59d-4843-903c-b46e3a80d06d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.802798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 352/713] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.802798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.802798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.802798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.823859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:45.824932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:45.855860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:45.889496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b3f21-8738-4467-a15b-7e7deed4abb7 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:45.899377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 353/714] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:45.900567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.931439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:45.932546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:45.933102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:45.933567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:45.934579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:45.935086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:45.936799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:45.943600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 362/715] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:45.944743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:45.972902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:46.036691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d661ab0-9023-41bc-b446-24becf83ccab None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:46.061280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c4346-67d5-48f3-9c68-95cc0fa81aed None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:46.099808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:46.103021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:46.103590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:46.104911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:46.106764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:46.109944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:46.127796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:46.129140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:46.130638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:46.130932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] PATH_INFO: `/v3/services/network` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:46.131613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:46.133079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:46.151166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:46.152300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:46.153185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 363/716] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:45 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:46.159148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:46.163797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 354/717] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:29:45 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:46.301748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:46.325279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26990-6f8c-47bf-84fe-f546c4830150 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:46.372841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:46.373506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:46.373787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:46.374060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:46.374767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:46.375100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:46.376477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ea4e5-dfb0-49ae-904c-eaadd976d4b0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:46.383676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 364/718] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:46.389542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:46.423974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:46.510384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86decb3b-a809-4b1e-8440-37d7bbf0b4fd None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:46.546458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:46.547152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:46.547436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:46.547715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:46.548431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] RBAC: Adding query filter params (type=network) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:46.548738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:46.550125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc780-a2cd-409a-aadd-3719eb0f64fe None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:46.555520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 355/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:47.191153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4cda-6b3e-47d7-a6dc-d997b5f5bfdd None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.191568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4cda-6b3e-47d7-a6dc-d997b5f5bfdd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.191739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4cda-6b3e-47d7-a6dc-d997b5f5bfdd None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.193301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 365/720] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:47.204675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.205274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.205274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.228604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:47.229792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:47.324650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 356/721] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 20:29:47.364392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4cda-6b3e-47d7-a6dc-d997b5f5bfdd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:47.492693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4cda-6b3e-47d7-a6dc-d997b5f5bfdd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:47.534885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:47.535708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.535984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.536273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.551794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:47.559535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:47.561669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:47.563687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 366/722] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:47.571159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:47.592059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:47.702578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0978-f9db-4c1b-bb88-d31541460c09 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:47.741669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:47.742438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.742777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.743023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.743774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:47.744077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:47.745455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713d5f-9fa1-4a04-923b-d4e8f1b70f66 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:47.753979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 357/723] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:47.759499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:47.779444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:47.865174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd9d0-fc82-4ffb-9ab5-8a89e0116607 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.865174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd9d0-fc82-4ffb-9ab5-8a89e0116607 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.865174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd9d0-fc82-4ffb-9ab5-8a89e0116607 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.872175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 358/724] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:47.873656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.873656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.873656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.888289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dff73-a2fc-485a-b3bd-45eefae50579 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:47.891965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:47.893956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:47.948527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:47.949698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:47.950181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:47.950673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:47.969175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:47.971198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:47.982048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 359/725] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:47.990550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:47.991668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:47.992579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:47.992579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:47.992579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:47.992579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:47.995214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 367/726] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:48.001415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.020197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.032478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.129462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.198122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe94e62-76bd-4eda-8893-1fed6da0eafc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.201678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92b52-bfc8-40e9-a085-b912d199a81c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.266181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.266794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.267109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.267390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.268148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:48.270002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.270680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.270981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.271258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.271993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:48.272301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:48.273719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:48.275674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca912c16-44bd-4ddf-bf98-458095b1adb3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:48.292010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 360/727] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:48.302720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.304654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 368/728] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:29:48 2022] POST /identity/v3/services => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:29:48.384458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.417888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bba-4335-41e7-b990-1dc9599c99d6 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.418446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bba-4335-41e7-b990-1dc9599c99d6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.418446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab0bba-4335-41e7-b990-1dc9599c99d6 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.420194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 369/729] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:48.425460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.425746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.426095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.427623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f534-6f21-4992-b222-a766b1d1526b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.444967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:48.446286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:48.513557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.514363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.514649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.514948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.522671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 370/730] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:48.532206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:48.533698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:48.545677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:48.555209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:48.557319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:48.559601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:48.563326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 361/731] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:48.564226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.603888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.659519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5c4b-571c-429b-a691-531440ed9b16 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.687052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ff5e-33de-407f-b47d-0cac135a108a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.697965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.698873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.699193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.699474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.711680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.714310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:48.722492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.723540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:48.723991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:48.725096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:48.726207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:48.727354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.727354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.727354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:48.727354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:48.727605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:48.730764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 371/732] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:48.736888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.747756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 362/733] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:48.753054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.855752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedbdb0-f2ed-45a7-9240-cda32daa971c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.870618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:48.888961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d634f4-8479-42e1-92ec-931bebdfed07 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:48.910950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.910950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.910950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.910950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:48.911367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:48.911367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:48.911367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:48.933019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 372/734] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:48.939401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:48.956758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:48.957416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:48.957694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:48.957963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.030754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.050812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.052386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af8f37-6c19-409c-87b7-f1580f728eea None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.098094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a29f-45ad-49cc-b354-c382af6e4e44 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.143679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.144641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.144932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.145214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.160412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.161869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.162631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 363/735] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 20:29:49.164291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79995db-8921-4ea0-b997-73a6d7d03095 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.164675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79995db-8921-4ea0-b997-73a6d7d03095 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.165042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79995db-8921-4ea0-b997-73a6d7d03095 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.166694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 364/736] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:49.168828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79995db-8921-4ea0-b997-73a6d7d03095 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-7d3720c0-a09b-44e4-8e9e-576fc82d0514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:49.188368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:49.190452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 373/737] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.192629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.211486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:49.212850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:49.240198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.271156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.293318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79995db-8921-4ea0-b997-73a6d7d03095 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.299790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:49.300814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.351229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.352813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.353106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.353382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.364643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.366104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-ea856483-c389-4a2d-9894-236672c6ffc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:49.385059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:49.386008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:49.386865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:49.386865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:49.386865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:49.386865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:49.386865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 365/739] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:49.387991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004f12-6e25-4d30-a97a-69c3a77befa6 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.388281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004f12-6e25-4d30-a97a-69c3a77befa6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.388534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17004f12-6e25-4d30-a97a-69c3a77befa6 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.389970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 366/740] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:49.392053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004f12-6e25-4d30-a97a-69c3a77befa6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.414531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6600a-d3dd-44d6-aa34-2495906945c6 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.448857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.449532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.449838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.450037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.450749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:49.451077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.452437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.468493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 375/741] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:49.468493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.485778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.517119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17004f12-6e25-4d30-a97a-69c3a77befa6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.551168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.551975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.552258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.552531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.555697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.565092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e42b3c24-cdc9-4a09-aada-974a27101b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:49.573235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:49.574150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:49.575039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:49.575656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3ba6d-001f-444e-ab23-f644d108ffe0 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.575731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 367/742] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:49.576370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.576370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.576667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.593184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:49.594382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:49.616213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.616935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.617226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.617499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.618227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:49.618536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.619958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.632261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 376/743] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:49.633194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.670146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 368/744] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 20:29:49.671340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.722440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.747829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8dfef-e53e-4719-aea6-e40b22c1cf68 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.785164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8551d-f4ba-4faa-adc8-0423a10ca058 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.785403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.786175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.786455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.786726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.794713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.796247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.811147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:49.812052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:49.813070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:49.814187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:49.818070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 377/745] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:49.818960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.827101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.827776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.828056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.828329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.829406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:49.829513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.830962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.844869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 369/746] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:49.844869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:49.937031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f63e8-03ad-4251-9f58-49de49566ebd None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.955233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa617c-9dff-40e1-bfd0-d8d4cd3dbf37 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:49.974853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.975680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.976001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.976281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.979722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:49.984427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.985970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:49.990960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:49.991673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:49.991954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:49.992333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:49.992945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:49.994300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:50.000534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:50.001788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:50.002687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 378/747] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:50.003612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.019034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 370/748] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:29:49 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:50.019034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.076272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.147940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979766-e4d4-4d8c-b3ee-e62eec95da7c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.164360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4373d-6337-4de9-978c-dccef32a2d14 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.187685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.188407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.188697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.188975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.200791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.202276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.206451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.207389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.207841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.208281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.209961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:50.210517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.212184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:50.221042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:50.221926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:50.222805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:50.222805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:50.222805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:50.222805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:50.222805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 371/749] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:50.223559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.233049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 379/750] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:50.234179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.314744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.329681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.338521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed580-3cab-4005-a651-a0a7ea0b15d8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.366499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9716-0682-4b14-b36f-e11e2f6b4942 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.375940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.376753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.377146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.377520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.378434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:50.378843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.380417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.394801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 372/751] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:50.402773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.424601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.426034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.426480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.426894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.427650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:50.427950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.429466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.449227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 380/752] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:50.450009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.524112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e513-6f62-45ea-aefe-8dc78fc27489 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.568915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81ac2f-e075-4d71-b674-5d48992c898c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.569408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.570364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.570690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.570980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.584561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.585679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.587509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.608651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.609614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.610155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.610606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:50.611300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:50.612150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:50.613032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:50.613032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:50.613032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:50.613032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:50.613032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 373/753] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:50.618174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.619083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=588e6f0b3d6a452ea8a197cc6930dc60) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:50.619643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.621417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.622817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.635340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 381/754] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/role_assignments?user.id=588e6f0b3d6a452ea8a197cc6930dc60&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:50.636840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.746480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a898167-6a90-478c-bf40-6388dc905602 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.790665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.791658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.791942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.792219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.805736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.805736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:50.822209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:50.823251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:50.824201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 374/755] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:50.829255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.853152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8a06-d727-4815-89f0-9b92a0bb9f9a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.889059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:50.889732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.890014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.890283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.891086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:50.891369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:50.892762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a91dfb-0327-4199-8300-d0ed0b4bc37e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:50.909415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 382/756] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:50.911506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eaaa-0b93-405f-85c0-1e8f722a07d8 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:50.912058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eaaa-0b93-405f-85c0-1e8f722a07d8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:50.912923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:50.913192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135eaaa-0b93-405f-85c0-1e8f722a07d8 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:50.916118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 383/757] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:50.917310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135eaaa-0b93-405f-85c0-1e8f722a07d8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:50.962171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f4b36-01db-4117-8e7d-44ae7f66e3e9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:50.967600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.008607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.010169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.010694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.011624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.013125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:51.013900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.015856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6dd02-a705-496b-a723-3a8355d27d5c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.039242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135eaaa-0b93-405f-85c0-1e8f722a07d8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.041097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 375/758] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:51.043642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.044176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.044727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.066425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:51.068293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:51.081413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.082539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.083171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.083646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.092112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.093974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:51.109842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:51.110749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:51.111660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:51.119528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 384/759] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:51.120765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.141045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 376/760] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:51.141962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.208496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.241716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.248274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173943a-c260-483e-a9f7-2b02f4be8ec6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.268780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbba16-a1f0-4187-8a42-e435d9818431 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.290347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.291049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.291360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.291775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.314030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.315640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.316146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.316726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.317793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:51.318524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.321180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.341078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 377/761] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:51.341078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.385079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.387314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.445028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedc8e-36be-4e07-89d5-a50efbab6b70 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.459927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.483155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.484143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.484530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.484913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.485671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.487295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:51.500609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:51.501582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:51.502573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 378/762] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:51.504400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.514384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.521777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 385/763] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:29:51.522841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.618611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e93269-5038-4bb7-87c3-d56b454e36b4 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.643499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfd5e-ab7e-4370-8983-bcf25bb19a88 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.665170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.665170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.665170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.665170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.670021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=8eebb29015984c98a0c6867dcb03fd71, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.671547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.691000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 379/764] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:51 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:51.692244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.695835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.696917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.697981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.699079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.701351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:51.701951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.704199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.717356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 386/765] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:51.725050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.778650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.837978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:51.898177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d77f7-0c49-4fa9-9b7f-bd3a046bf95c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.922670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a118f-0cfc-41db-87de-78d65b3eaf17 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:51.946396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.947672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.948351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.948802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.964067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.966135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.968737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:51.969668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:51.969812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:51.970029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:51.970740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:51.971878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:51.973245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:51.980510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 387/766] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:51.986028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:51.988972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:51.990031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:51.991222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:51.991222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:51.991222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:51.991222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:51.993833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 380/767] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:52.003040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.145477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.162876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cd710-3b44-41c6-9ae0-64994cfd97b6 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.176056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a28b-c6fb-4116-adf4-501e13310d7d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.206910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.207762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.208360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.208645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.209380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.209670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:52.210039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.211730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697f2-0a1a-4214-bd24-5ceb31a34919 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.214199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.214996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.215342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.215679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.216543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] RBAC: Adding query filter params (interface=public, service_id=af35687e1cfc499abb88b6567dc77a2c, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:52.216920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.218350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d462-8c19-4549-96b0-41592a276943 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.225386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 381/768] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:52.227325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4b0f-eebb-4867-a4fe-41db2f84aac8 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.227671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4b0f-eebb-4867-a4fe-41db2f84aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.228006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4b0f-eebb-4867-a4fe-41db2f84aac8 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.231004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 382/769] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:52.231775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4b0f-eebb-4867-a4fe-41db2f84aac8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.236070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 388/770] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:29:51 2022] GET /identity/v3/endpoints?service_id=af35687e1cfc499abb88b6567dc77a2c&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:52.237336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.237620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.237893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.259671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:52.261132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:52.335585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 389/771] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:52.336518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.372287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4b0f-eebb-4867-a4fe-41db2f84aac8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.412648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.413583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.414075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.414362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.423848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.425317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:52.445467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:52.446424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:52.447367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:52.448358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 383/772] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:52.449377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.454369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c592-4f55-4bb7-bedb-452246efcce2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.466141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.482007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.496838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.497646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.498027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.498399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.499244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.500780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.508572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 390/773] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:52.509582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.630250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6dc2-df94-42c9-9097-985c777092af None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.692137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.693398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.693821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.694236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] PATH_INFO: `/v3/services/network` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.695240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.696954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.699945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3fee7-cc73-4e47-bf1a-131167b4cb06 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:52.721337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:52.723939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:52.725332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 384/774] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:52.732239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.736328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.737016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.737388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.737663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.738535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:52.738845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.740415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.754414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 391/775] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:52.763394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:52.831334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.839863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:52.890169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f69-147b-406f-9bd3-79ff0c10f1af None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.928127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fa8f2-cf24-452a-9789-ce630498b974 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:52.953723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:52.954313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:52.954594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:52.954872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:52.955604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] RBAC: Adding query filter params (name=network) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:52.955909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:52.957281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:52.973994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 385/776] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:52.979892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.097727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3127-a361-4a47-a65a-696f8f711171 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:53.108792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.109551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.109932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.110321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.111287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=4dce5ff2de9342969b39fca8578fca98) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:53.111705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:53.113417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c89cf8-2a70-4ce5-a67c-e9d7de2e98db None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:53.119813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 392/777] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/role_assignments?user.id=4dce5ff2de9342969b39fca8578fca98&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:53.121331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a598da-5569-46f3-a5a3-9d4a2223cb4f None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.121636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a598da-5569-46f3-a5a3-9d4a2223cb4f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.122036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a598da-5569-46f3-a5a3-9d4a2223cb4f None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.128078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 393/778] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:53.129823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.130157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.130536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.138368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.139080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.139414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.139702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.140430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] RBAC: Adding query filter params (type=network) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:53.140751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:53.142232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:53.148706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 386/779] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:53.149651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:53.155935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:53.157245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.167129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:53.257576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 394/780] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:53.280723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.326239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:53.391289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9865f4-91a1-46e2-8401-2df58e7ad478 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:53.434624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91d179-4daf-4496-aea5-4a36707e8e01 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:53.452000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.452721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.453008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.453284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.454087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] RBAC: Adding query filter params (interface=public, service_id=56e3f72b803a4755ae4a46419c539271, region_id=RegionOne) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:53.454403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:53.455837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:53.471390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 387/781] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:29:53 2022] GET /identity/v3/endpoints?service_id=56e3f72b803a4755ae4a46419c539271&interface=public®ion_id=RegionOne => generated 194 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:53.480042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.498951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.499783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.500122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.500403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.522170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:53.536193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:53.537179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:53.538022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:53.538712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 395/782] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:53.547625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.613049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:53.685440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4ba9-a4a3-4eb8-84a6-43af3f3cba11 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:53.734006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:53.740965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118c8d-7396-44bf-acb9-0a589663d290 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:53.745772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.746461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.746749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.747064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.747760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:53.749144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:53.756955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 388/783] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:29:53 2022] GET /identity/v3/services => generated 772 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:53.797324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:53.798401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:53.798961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:53.799437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:53.800412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:53.800914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:53.802540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:53.820768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 396/784] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:53.826813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:53.993039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aff86-6b29-42e7-99a2-b4186e643c75 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.024118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:54.031186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.032172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.032492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.032956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.044300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:54.045836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-99726cac-fe47-404f-9529-d5afeb7bc54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:54.063347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:54.064219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:54.065099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:54.065099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:54.065099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:54.065099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:54.065099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 389/785] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:54.070671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.080854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93d2e-8663-4c3a-a476-7ccd8043c874 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.081139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93d2e-8663-4c3a-a476-7ccd8043c874 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.081416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f93d2e-8663-4c3a-a476-7ccd8043c874 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.082933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 390/786] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:29:54.088102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.088379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.088650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.107731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:54.108917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:54.191842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cbfdb-bc7e-4fc3-a5c6-a591063bcbb9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.239755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.240561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.240845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.241161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.241963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:54.242320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:54.243881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:54.273454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 397/787] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:54.279204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.325124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:54.330952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 391/788] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:29:54.367717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.476272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b39ee0-0413-4a2d-8ff9-b43c564f860e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.534323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a148ad-ab97-49e6-b41c-45f10d7524dc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.550576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:54.568240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.569055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.569336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.569638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.573689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.574851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.575302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.575613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.587558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:54.589018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:54.596073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:54.608373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:54.609325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:54.610168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:54.611985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 392/789] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:54.618272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:54.619459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:54.621626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:54.624684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.625089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 398/790] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:54.625089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.744042 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:54.769331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205809b-f47a-4cc3-b06c-85d0697d2ff7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.832217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.832806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.833087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.833355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.834322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:54.834734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:54.836612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127e2b0-dc3b-4fb1-89c3-7ee7239fa53c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:54.838120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d6830-917b-4a10-805f-f07b857b7861 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.855773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 399/791] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:54.857372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465afc22-9aba-4aa3-8070-6e7e0c5e3c39 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.857975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465afc22-9aba-4aa3-8070-6e7e0c5e3c39 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.858098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465afc22-9aba-4aa3-8070-6e7e0c5e3c39 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.863343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 400/792] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:54.864115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465afc22-9aba-4aa3-8070-6e7e0c5e3c39 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:54.881759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:54.882809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.883329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.883784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.884712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:54.885239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:54.886786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c781554-bd95-48eb-ab28-8dd82b7e0f6c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:54.895775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 393/793] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:54.897209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:54.897722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:54.898223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:54.914770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:54.916307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:54.943488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:54.978325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465afc22-9aba-4aa3-8070-6e7e0c5e3c39 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:54.987080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 394/794] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:54.988169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.036606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.037379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.037659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.037933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.045899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.050455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.051997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:55.071320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:55.072276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:55.073198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:55.073198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:55.073198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:55.073198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:55.073198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 401/795] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:55.073922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.097181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b999-9fd2-4a53-9634-1ccdcad62919 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.133271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.134466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.134968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.135469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.147452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.149381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:55.168860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:55.169848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:55.170739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:55.170739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:55.170739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:55.170739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:55.172900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 395/796] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:55.173970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.184566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc3f4-1d69-40b6-ac08-86b3d561f1d3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.194474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.221923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.222748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.223076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.223630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.224079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.225532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:55.238563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:55.239582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 20:29:55.240398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:55.245301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 402/797] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:55.246300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.293230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481079ed-ac2b-4435-82d2-90c61345f711 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.306231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.334849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.336435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.336969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.337485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.338518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.339155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.340756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.354929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49a7b-5108-4004-9f0c-a3a972e4635c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.356159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 396/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.357181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.391971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.393035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.393470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.393928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.394788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.395333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.396854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.414831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 403/799] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.416020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.436951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.461616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd012a3-19c6-4d74-9c94-9e82c78fb3d4 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.499173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.499843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.500126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.500394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.501397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.501513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.502865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.508435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 397/800] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.509836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.529838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c7eec-583f-409d-9868-4d0a81136972 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.545678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.570831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.572063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.572525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.572940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.581116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.582750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:55.598664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:55.599790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:55.600944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:55.603638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 404/801] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:55.604708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.633226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad2d0d-51cc-478f-a0db-8d1b6bdf5bd5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.672233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.673048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.673337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.673615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.681486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.682961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.686107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:55.700878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:55.701870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:55.702792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 398/802] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:55.703863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.725832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785895-7798-49b5-8c38-4263b93c1b51 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.765285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.766152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.766353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.766615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.767477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.767785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.769324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6428-22aa-40e8-83d5-d51ed7bf844e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 405/803] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3985bd-a1bf-4cc7-bef1-c4c235bae7e2 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3985bd-a1bf-4cc7-bef1-c4c235bae7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3985bd-a1bf-4cc7-bef1-c4c235bae7e2 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 406/804] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:55.779258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3985bd-a1bf-4cc7-bef1-c4c235bae7e2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.813399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5cc30-0a4d-4f27-89cd-b0537eb5e0fb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.829802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.850697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.851494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.852115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.852629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.853190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.853502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.854970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.878471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 399/805] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.878471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:55.905689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3985bd-a1bf-4cc7-bef1-c4c235bae7e2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:55.942491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:55.949202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:55.949886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.950173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.950451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.951351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:55.951670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:55.953086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864520f-242d-4235-9fe8-c9c58e2a0f0e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:55.971989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 407/806] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:29:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:55.973259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:55.973542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:55.973811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:55.989895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:55.991093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:55.994599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddc0ca-0fcf-466f-8161-309e28b53d39 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.032527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.033277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.033564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.033834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.034592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.035952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.057619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 400/807] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:29:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:56.058410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.080274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 408/808] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:56.081571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.127115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.214302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049cb77-cffe-41a6-9fa5-e11417aa719c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.233958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.241586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5699726-e91a-4dcc-b108-c79d68664716 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.260615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.261415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.262189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.262189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/588e6f0b3d6a452ea8a197cc6930dc60/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.265772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=588e6f0b3d6a452ea8a197cc6930dc60, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.267926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.282890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.283102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 401/809] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:56 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/588e6f0b3d6a452ea8a197cc6930dc60/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:56.284302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.284418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.284552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.284552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.379621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.382031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8af0c-31ff-40ac-a41b-745e9e75e10a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.409852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.443349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987338e-3ae5-4acf-997b-ebfc88f6ecc8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.490363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.491263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.491640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.492016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.509794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:56.516287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 409/810] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:29:56.517944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960e13-7ac5-43f1-b001-d51d5f4e6141 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:56.518389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:56.519345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:56.520168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 402/811] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:56.521491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960e13-7ac5-43f1-b001-d51d5f4e6141 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.521694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.522166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960e13-7ac5-43f1-b001-d51d5f4e6141 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.524125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 410/812] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:56.525212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3960e13-7ac5-43f1-b001-d51d5f4e6141 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.569784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.659239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5605a29-bd89-4a82-9371-3129e42df1c8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.661923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3960e13-7ac5-43f1-b001-d51d5f4e6141 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.689572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.697217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.698123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.698413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.698692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.703070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.703839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.704249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.704579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.705440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:56.705805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.707609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab24ed-21bb-4444-9a7a-c317fe5742c0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.710121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.711775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.722755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 411/813] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:29:56.724253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.724750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.725091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:56.731913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:56.732809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:56.733696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:56.733696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:56.733696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:56.733696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:56.733696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 403/814] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:56.734308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.746789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:56.748189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:56.837226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 412/815] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:56.838321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.838549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:56.845991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca3c-4929-414e-8493-66fc09f08769 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.891200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:56.892263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:56.892549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:56.892843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:56.906532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:56.908423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:56.937206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:56.938177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 404/816] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:56.945463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:56.972728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7d760-ac14-4efb-beb8-c6c7b8814211 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:56.988715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.012271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.013210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.013501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.013780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.014628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.014955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.016375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.029077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 413/817] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.030304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.092425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a7a1d-bc12-4411-9641-ca0345765870 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.139509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5f9ad-f4b1-4001-bd64-f254f244fe96 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.140525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.142069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.142794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.143528 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] PATH_INFO: `/v3/services/network` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.144816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.146662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:57.160574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:57.161855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 20:29:57.163644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:57.171867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 405/818] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:56 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:57.173199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.176299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.176993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.177349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.178528 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.178640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.179961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.180370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.181833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.200317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 414/819] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.200317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.235348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.310466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907086de-1859-4c9f-b3d4-f936a1959b2e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.320226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5b92-3469-419b-a60a-830028ed6b19 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.350547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.351417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.352349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.352632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.353358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] RBAC: Adding query filter params (name=network) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.353665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.355071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.365073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 415/820] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.365073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.375388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.376929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.377695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.378279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.387646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.389412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:57.406175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:57.407749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:57.409245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:57.413271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 406/821] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:57.414990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.467324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.471877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dc23d-69d0-4106-898a-fb0b073b7111 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.502102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.516492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.517914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.518463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.518909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.527441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.529153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:57.546372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:57.547595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:29:57.548542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:57.555134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675785cf-aad9-4f67-8681-b6fc83a4907c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.556429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 416/822] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:57.557554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.597631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.598311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.598664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.599033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.599862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] RBAC: Adding query filter params (type=network) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.600300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.602550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.611070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 407/823] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.612402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.694153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e466-0b53-4312-a3b9-a71291b864c7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.737642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.738791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.739162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.739623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.740608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.740977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.742262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3251ca-d7e6-4420-86ca-3a80ac87ce31 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.742748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.762222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 417/824] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.762222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.781747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.784490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:57.793611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.794853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.795603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.796098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.797709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:57.798466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.800575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.828981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 408/825] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:57.828981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:57.878270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00e988-ec70-4938-8bc0-496b9e856531 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.913101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:57.914462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:57.915034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:57.915575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:57.916537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:57.918109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:57.939393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474536a4-97c8-4e64-8151-cbd062cdb219 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:57.944055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 418/826] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:29:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:29:57.945420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.027961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.029003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.029502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.030025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.031109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:58.031654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.033310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.041311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 409/827] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:58.120683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.164238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae4c1-894f-4bf7-8871-e26e2767be9f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.207795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.207795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.207795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.208143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.221705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.223535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-1e9a177e-cdfd-4f3a-b890-363d8d5de390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:58.243080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:58.244170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:58.245108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:58.245108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:58.245108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:58.245108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:58.246937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 419/828] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:58.252766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.267286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede01f0-e211-4448-9466-e7e76ff9eb43 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.267796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede01f0-e211-4448-9466-e7e76ff9eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.268538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede01f0-e211-4448-9466-e7e76ff9eb43 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.270637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 420/829] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:58.276799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.277278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.277688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.298237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:58.299769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:58.318090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.384157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335b347-8418-45f1-830f-24d2837c1ade None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.387144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 421/830] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:58.409864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.430032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.431069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.432414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.433084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.434291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:58.434787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.437041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.457637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 410/831] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:58.464344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.474385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.521734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23911d-19dd-4910-8071-75a456bf8bcd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.560855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.561661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.561936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.562204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.563349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.565090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5e2378f0-e345-45d1-bafc-048cb6b73c80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:58.577775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:58.579052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:58.579870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 422/832] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:29:58.580669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934baa-08da-4bab-8741-f5fdb5808773 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.580735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934baa-08da-4bab-8741-f5fdb5808773 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.581006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934baa-08da-4bab-8741-f5fdb5808773 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.582381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 423/833] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:29:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:29:58.587298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934baa-08da-4bab-8741-f5fdb5808773 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.594634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9efe-65a8-42c9-8af9-6dd05598301b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.605612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.634804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.635723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.636077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.636442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.643470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.644926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-256eb4fc-7161-47ca-8663-c941dae23694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:29:58.660236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:58.661067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:58.661959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 411/834] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:58.663029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.663029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.663182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.682768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:29:58.683811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:29:58.702297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934baa-08da-4bab-8741-f5fdb5808773 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.723372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.739358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.740023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.740306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.740582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.741290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:58.741660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.743062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.747891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 424/835] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:58.753003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.758953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 412/836] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:29:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:29:58.758953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.853932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:58.860165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d036fe-2fdd-42ba-a99c-7df7b49bc22c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.866595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8018c6-14d2-47df-9538-184bbae9f7ef None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:58.896904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.897754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.898402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.898757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.899610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:58.900008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.901508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.902737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:58.903422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:58.903820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:58.904088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:58.904874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:58.905176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:58.906584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:58.915241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 413/837] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:58.915241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:58.934932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 425/838] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:58.936007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.005984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:59.054234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb8d8-ebc8-4a5b-9a79-74963322f5bc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.072066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35697ddf-b5bf-4cd1-9a38-7865bc5764b5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.102658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.103489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.103773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.104046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.119224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:29:59.126680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:59.127767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:29:59.128590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 414/839] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:59.134228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.134228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.134228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.134228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/4dce5ff2de9342969b39fca8578fca98/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.135301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.153809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=4dce5ff2de9342969b39fca8578fca98, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:59.156221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:59.158731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:59.176194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 426/840] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:29:58 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/4dce5ff2de9342969b39fca8578fca98/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:29:59.251704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a91b-f10e-48b7-9168-e57f04e41f9a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.293600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.294387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.294672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.294968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.295810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:59.296118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:59.297634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:59.308512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 415/841] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:59.314135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.417421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:59.424585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103f41-8271-46a1-833e-e76707c9c51e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.461638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.462683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.463131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.463538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.474079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:59.475775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:29:59.493971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:59.495073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:59.496254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:29:59.496254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:29:59.496254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:29:59.496254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:59.498076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 427/842] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:59.504114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.593433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:29:59.612910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2588a7-b213-49e0-a846-5c5926b08d27 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.646874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.647863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.648313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.648728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.649586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:29:59.650027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:59.651603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:59.665150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 416/843] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:29:59.673013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.781174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a2dc5-1799-4fad-bc01-7f2f2979252d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:29:59.820972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:29:59.822173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:29:59.822646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:29:59.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:29:59.830682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:29:59.832393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:29:59.847111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:29:59.848044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 20:29:59.848961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:29:59.851636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 428/844] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:29:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:29:59.857785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:29:59.963456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9159c-569a-4a8b-8571-2fab3e781bde None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.000162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.000831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.001116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.001394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.002238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:00.002548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.004016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7ec1-0a50-4483-aede-64d260e15c98 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.018325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.021992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 417/845] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 13 20:29:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:00.028453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.038484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.133416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f1fa-a058-4b13-b724-2890df6257f6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.167335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.168361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.168830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.169290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.228415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3593d-4c55-44f5-8813-c940e5bdbdf8 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.228759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3593d-4c55-44f5-8813-c940e5bdbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.228972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3593d-4c55-44f5-8813-c940e5bdbdf8 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.230593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 418/846] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:00.235938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.235938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.236169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.238405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.240230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.253685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:00.255187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:00.256326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.344220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 419/847] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:00.345367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 429/848] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:00.353547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.366667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.473313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a2442-06e3-43b5-a446-5e14752adaec None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.474459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2121a0-5525-475b-ba7b-b7f79f0a4e9d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.484032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.504878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.511783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.512835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.513364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.513835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.521011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.521917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.522266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.522608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.523423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.524904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.525609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.527547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:00.537638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:00.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:00.539474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:00.543198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 430/849] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:00.545642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:00.550863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:00.551740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:00.552643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:00.552643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:00.552643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:00.552643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:00.559405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 420/850] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:00.561872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.674027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d032-1f5b-455f-95f2-6c2b1629a006 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.681146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6772cf-80ba-44ec-bd8d-cd613e0fa460 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.709648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.710373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.710654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.710944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.711708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:00.712014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.713395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.727205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 421/851] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:00.731283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.732498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.733240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.733532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.733940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.734732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:00.735428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.737845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.748350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 431/852] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:00.749910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:00.782560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.797313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:00.858564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df9211-36d6-4325-9c2d-2b938e63b71b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.866217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12681acb-035d-4b6c-9287-c8acd1ee60ab None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:00.901653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.901893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:00.902536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.902821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.903131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.903489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:00.904112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:00.904596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:00.905506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:00.906008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.907624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.910801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:00.912550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:00.919133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 432/853] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-fb875c46-4578-49b7-961d-cac79ddde45f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:00.927967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:00.928913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:00.930788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 422/854] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:00.935753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.043032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:01.046826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3135-75f5-4b31-b672-1c2eae563d97 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.076948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed374a-8d1c-46e3-8ece-30709aec7aa6 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.077297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed374a-8d1c-46e3-8ece-30709aec7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.077511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed374a-8d1c-46e3-8ece-30709aec7aa6 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.079091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 423/855] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:01.084635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.084928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.085234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.090419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.091160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.091446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.091723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.092523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:01.092838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:01.094271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:01.109345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:01.109599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 433/856] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:01.111101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:01.119961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.203392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 424/857] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:01.221022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.235250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370b9f-3710-43a8-a853-5e53bd00943c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.255754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:01.277163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.278161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.278449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.278852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.279862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=588e6f0b3d6a452ea8a197cc6930dc60) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:01.280175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:01.282052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c6f6d-5d57-4766-870d-66263412f172 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:01.291276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 434/858] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:01 2022] GET /identity/v3/role_assignments?user.id=588e6f0b3d6a452ea8a197cc6930dc60&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:01.353297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670ea0d-5fcb-49f6-bf01-8898eb331d21 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.360850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd72ab-fa69-4e11-acc3-3a811d5af839 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.361209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd72ab-fa69-4e11-acc3-3a811d5af839 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.361419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd72ab-fa69-4e11-acc3-3a811d5af839 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.367067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 435/859] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:01.369070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.369451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.369819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.387756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:01.389331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:01.399475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.400963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.401404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.402270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.403520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:01.405431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:01.408902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:01.427564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 425/860] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:01 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:01.486000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 436/861] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:01.511760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.613725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:01.624778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956eae3a-32c3-47a3-9714-d58dc3bc51d6 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.662264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.663432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.663929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.664392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.676950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:01.684935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:01.685902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:30:01.686730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:01.689480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 426/862] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:30:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:01.698944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.796125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f341ca-05cd-44e8-ad62-21e9bcd391cd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.830709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.831415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.831698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.831971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:01.832724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:01.833030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:01.834403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:01.843540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 437/863] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:01.848853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:01.951612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7859-14fa-4832-a951-ee266e8b8aa7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:01.990615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:01.991509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:01.991889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:01.992447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:02.002911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:02.004408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:02.023478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:02.024403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:02.025367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:02.025367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:02.025367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:02.025367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:02.025367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 427/864] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:02.030476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:02.047924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:02.139210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadc6f0-c834-47a7-8b04-823497625bba None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:02.172721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:02.173391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:02.173670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:02.173938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:02.174665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:02.174994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:02.176361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:02.193174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 438/865] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:02.198503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:02.202411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:02.304168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5247b-70ec-4254-a88a-171f3201a197 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:02.340410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:02.341468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:02.341946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:02.342388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:02.350407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:02.352614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:02.367025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:02.368127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:02.369272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:02.371514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 428/866] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:30:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:02.382960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:02.444965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:02.480559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a78c8-e5c6-4048-8815-1b2d11248562 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:02.514865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:02.515562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:02.515846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:02.516129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:02.516975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:02.517278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:02.518704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:02.536939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 439/867] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:30:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:02.542226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:02.612865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:02.651750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2edfe7-58c8-4487-9c72-2d9436b29e00 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:02.686480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:02.687149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:02.687431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:02.687704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:02.757645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:02.759120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f784-24c6-40b6-83d5-9cee81f986f9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:02.819049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:02.857658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 429/868] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:02 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:02.863337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:02.968231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d153-2967-46bc-9aab-44363a336fe2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:02.996044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.003977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.005247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.005547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.005810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.016375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.017837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:03.035699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:03.036630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:03.037513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:03.037513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:03.037513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:03.037513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:03.037513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 440/869] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:03.038754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651bac-d679-45a2-bd30-f3d9b27999f9 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.039222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651bac-d679-45a2-bd30-f3d9b27999f9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.039521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651bac-d679-45a2-bd30-f3d9b27999f9 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.040889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 430/870] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:03.043906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.049046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.049340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.049625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.069360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:03.071244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:03.155906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 431/871] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:03.156690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82d82-0444-4566-89cc-e9968afa964c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.177896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.192728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.193566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.194082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.194393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.195718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:03.195832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.197243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.210732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 441/872] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:03.216886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.271082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.290422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.299461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d4153-2515-4240-b038-e4da6956c3d2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.346578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.347392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.347681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.348006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.348753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.349946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb7cf5-69a9-405d-b42e-b23987f02925 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.350188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.371002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 432/873] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:03 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:03.408078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.409229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.409775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.410254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.419000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.421175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-60431911-04e4-4600-b227-0f51901f9a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:03.436940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:03.437901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:03.438771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:03.441497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 442/874] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:03.447998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.543821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a23-2b61-47b9-8bd5-48c88d64f617 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.544115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a23-2b61-47b9-8bd5-48c88d64f617 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.544390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf13a23-2b61-47b9-8bd5-48c88d64f617 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.545778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 443/875] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:03.551743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf91de-6dd7-4d27-9bee-1061cc3cdd2f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.552026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf91de-6dd7-4d27-9bee-1061cc3cdd2f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.552388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf91de-6dd7-4d27-9bee-1061cc3cdd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.564307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8cc2-bfad-4b02-a7a4-a47a438049bc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.571980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8bbf91de-6dd7-4d27-9bee-1061cc3cdd2f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:03.573190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8bbf91de-6dd7-4d27-9bee-1061cc3cdd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:03.611531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.612223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.612505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.612781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.613580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:03.613897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.615387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.629692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 433/876] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:03.634794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.651933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.665044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 444/877] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:03.665044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa878-30b4-4406-974a-bca997d24b90 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.665044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa878-30b4-4406-974a-bca997d24b90 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.665347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa878-30b4-4406-974a-bca997d24b90 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.670429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 445/878] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:03.671918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.672540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.673013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.692466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:03.693687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:03.715795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.753359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea09c3-3a96-428f-a6f3-5c55999ef29e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.767034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 446/879] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:03.771812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.792879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.793533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.793815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.794087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.794974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=4dce5ff2de9342969b39fca8578fca98) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:03.795249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.796680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.803089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 434/880] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/role_assignments?user.id=4dce5ff2de9342969b39fca8578fca98&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:03.803762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.895256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed44916-97cd-43aa-9b8a-95e238575eaa None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.920999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.934846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.936359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.936359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.936697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.937481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:03.939018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:03.950829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23afc7-9fbe-4b41-8d1f-bc04c845ad46 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:03.953068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:03.954241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:03.955280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:03.957593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 447/881] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:03.963966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:03.995520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:03.996145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:03.996737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:03.997156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:03.997665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:03.998585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.000174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:04.012599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:04.013818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:04.014792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:04.022109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 435/882] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:04.023198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:04.098093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f727d-0d74-4cec-a6e1-47cf2da5d0ad None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.135922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.136689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.137032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.137374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.138148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:04.138518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.140024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.141584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930045b-82d7-4a1e-b60b-4a6c5c9b1b7b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.146965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 448/883] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:04.152087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:04.195171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.196621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.197016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.197432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.198281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:04.199165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.201113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.208697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 436/884] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:04.214343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:04.223663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:04.245606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:04.263835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90faf-7efd-4f27-9ebe-e2042bec899d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.300176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.301275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.301725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.302163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.303102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:04.303668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.305524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.311034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 449/885] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:04.328547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0b48-066a-4577-9f8c-22c93ab22615 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.368140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.369274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.369736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.370179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.371173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:04.371686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.373306 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.379961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 437/886] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:04.385826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:04.530732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8fdd-9c2c-46b7-b329-5a66ddb32caa None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.573883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.575248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.575796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.576323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.577355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] RBAC: Adding query filter params (interface=public, service_id=0667e1a9f83c4be78d5eb5265396c7b3, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:04.577917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.579677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ccb02-602a-4873-b27c-7523b0660f32 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.592883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 450/887] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:30:04 2022] GET /identity/v3/endpoints?service_id=0667e1a9f83c4be78d5eb5265396c7b3&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:04.599162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:04.710831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:04.744902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15b07-956f-4ede-b193-42750f8d0b86 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:04.781068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:04.781964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:04.782422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:04.782844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:04.783992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:04.786265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd41db-8d7e-472c-b882-78f761f6e79c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:04.793036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 438/888] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:04 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:30:05.547002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e35d-0f03-42cd-bc49-5c34dbb41e88 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:05.547002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e35d-0f03-42cd-bc49-5c34dbb41e88 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:05.547002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e35d-0f03-42cd-bc49-5c34dbb41e88 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:05.548002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 451/889] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:05.554029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:05.555033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:05.555485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:05.573613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:05.575130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:05.651017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 439/890] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:05.679326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e35d-0f03-42cd-bc49-5c34dbb41e88 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:05.695595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:05.784722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e35d-0f03-42cd-bc49-5c34dbb41e88 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:05.819091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:05.819947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:05.820227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:05.820502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:05.821151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:05.822570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:05.835142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:05.836152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:05.836980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:05.841456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 452/891] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 13 20:30:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:05.842844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:05.906287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:05.946174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d03b-2d21-4850-b2e2-ca6d341df666 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:05.981450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:05.982120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:05.982406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:05.982686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:05.983598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:05.983915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:05.985307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5f45b-2ec7-4449-b30e-5528ba041bac None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:05.990258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 440/892] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:05.996344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.072520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d93b-676f-4048-9512-63d21b43eb46 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.072900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d93b-676f-4048-9512-63d21b43eb46 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.073191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d93b-676f-4048-9512-63d21b43eb46 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.075167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 441/893] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:06.081033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.081033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.081033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.103864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.104298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:06.106659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:06.131359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba58d8-95e6-4de7-b8f5-86c7a3924897 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.167573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.168235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.168514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.168786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.169594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:06.169904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.171401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.181868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 453/894] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:06.182898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.183933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 442/895] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:06.206774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.281460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.303414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21b88-ba57-41e1-97b9-f839e3beeb8a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.337632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acb364-a3ae-492b-9235-8b26bc9df936 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.341392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.342300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.342778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.343303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.344305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] RBAC: Adding query filter params (interface=public, service_id=4c8c7c10213c40edb487da38964dc39b, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:06.344810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.346438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.353072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 454/896] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/endpoints?service_id=4c8c7c10213c40edb487da38964dc39b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:06.358357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.364199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.378853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.379741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.380037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.380301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.394453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:06.406544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:06.407560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:06.408410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:06.411409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 443/897] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:06.415307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.498252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe7ed-7eab-4e9b-8302-dcd12a3bc640 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.535191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.535965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.536250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.536530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.537217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.538600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc577-f605-4dcd-8b79-6fba8c02447b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.538712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af618061-89e4-427d-82a5-9d58f5fdfe62 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 455/898] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058d05-4201-40a7-8572-df4a0ef833e1 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058d05-4201-40a7-8572-df4a0ef833e1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058d05-4201-40a7-8572-df4a0ef833e1 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 456/899] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:06.555168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.556164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.556164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.568683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.578167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:06.580288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:06.590769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.591408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.591693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.591973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.592734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:06.593043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.594560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.609138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 444/900] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:06.614098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.677394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.692646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 457/901] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:06.708795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.748246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226b560-c913-4c9f-b38e-8cef21f56547 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.786136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.787077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.787305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.787737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.800105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.801616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:06.821291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:06.822322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:06.823633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:06.823633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:06.823633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:06.823633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:06.823633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 445/902] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:06.828443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:06.850976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd82a2-5c51-4286-9b9c-cca2e508ae6c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.862886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:06.900837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.901878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.902362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.903083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.903876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:06.905510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae911b-d6f9-46b6-a349-cebb8c9438f1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:06.926945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 458/903] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:06 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:06.950355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c68a8-f9a7-4d33-8eb8-7ebcef5ad2db None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:06.996286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb02c2-879f-4b41-91ac-ef62d2a61eff None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.996573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb02c2-879f-4b41-91ac-ef62d2a61eff None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:06.996850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb02c2-879f-4b41-91ac-ef62d2a61eff None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:06.998251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:06.998541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 459/904] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:06.999354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:06.999980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.000449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.001407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:07.001935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.003887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.004174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.004457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.004559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.021466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 446/905] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:07.027601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.027793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:07.028884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:07.095874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.118638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 460/906] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:07.140555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.144007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.153745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b73a9-0105-40b7-ab1f-c849a4c5b7c0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.199499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.200857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.201218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.201569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.212120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.214591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:07.237678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:07.238693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:07.239659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 447/907] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:07.245541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.303398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a7e8b-cf76-4df3-b58d-98f743041367 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.366360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.368946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.369404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.370653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.371561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.375841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:07.391388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:07.392412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 20:30:07.393234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:07.408234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda64d-c54c-4655-8f66-182b54793d9c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.410207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 461/908] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:07.411286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.470132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.471194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.471652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.472117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.473139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:07.473621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.475287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.499009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 448/909] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:07.515047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.515549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.531091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.605690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201addf6-591d-450d-8c98-cdc89ea0dfdc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.641596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d0c5-64d0-4bb2-bc19-f37aff0b8ab9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.692133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.693448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.694015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.694516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.708443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.709121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.709405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.709683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.710544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:07.710724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.712128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.726533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 462/910] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:07.732251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.785014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.787042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.796907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.849506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea289fe8-a26d-4b62-8a5a-5442a8f55ed8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:07.870867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:07.892791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:07.893386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:07.893670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:07.893946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:07.895092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:07.895402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:07.897307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:07.904133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 463/911] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:07.905396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 449/912] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 20:30:07.910680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:07.911066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.025242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b53da-9f8a-498c-8ded-b4a3f9104fba None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.041728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b51c-ba40-423e-a19f-93341f602040 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.051315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:08.069923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.071087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.071533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.072352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.073520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.075523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.082904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.084120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.084507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.085061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.098179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.099693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.103772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 464/913] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:08.124354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:08.125368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:08.126311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:08.126311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:08.126311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:08.126311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:08.130678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 450/914] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:08.132487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.178198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:08.261591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9f37-64ac-4cd2-8dbb-51206f758cac None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.297839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.298533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.298820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.299129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.299861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:08.300170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.301539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.314401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 465/915] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:08.321131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.427256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40deb214-48ec-46d1-bbc0-b1a922f99ebf None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.466450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.467290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.467625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.467911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.474929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.476617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:08.490840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:08.491899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:08.492757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 451/916] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:08.500051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.595354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:08.606807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d286-0d7e-4bb2-b026-b6b48ebe33d3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.643049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.644087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.644569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.645053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.646038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:08.646573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.648525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c4aa-9bd1-43e2-bfd1-23cb9bbee641 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.662037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 466/917] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:08.670520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.691874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:08.699758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13016cdb-e7a4-47db-bec0-8b48f784b56c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.700064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13016cdb-e7a4-47db-bec0-8b48f784b56c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.700323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13016cdb-e7a4-47db-bec0-8b48f784b56c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.701961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 467/918] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:08.706803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.707126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.707409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.725753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:08.727248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:08.801028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6239089-e673-46a2-800f-308cc05635ad None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.807274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 468/919] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:08.821312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:08.838887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.839814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.840461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.840745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.841581 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] RBAC: Adding query filter params (role.id=e01a3ff199d44e5595fa6d6290690086, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=4dce5ff2de9342969b39fca8578fca98) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:08.841897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.843765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.850508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 452/920] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:08 2022] GET /identity/v3/role_assignments?user.id=4dce5ff2de9342969b39fca8578fca98&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=e01a3ff199d44e5595fa6d6290690086 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:08.935315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:08.939692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7858-da64-4979-b4ac-510031d340c8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:08.978564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:08.979406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:08.979690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:08.979965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:08.980689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:08.982105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-9607c50b-bb1a-4fc2-aa1b-5891d736b259 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:08.995599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:08.996661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:08.997530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 469/921] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 13 20:30:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:09.003408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.093181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:09.113116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2c1d-12e8-4cb8-8dfa-6c530470e6e1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.119312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1fbe-e129-4e3b-a8e8-0627513a84e6 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.119595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1fbe-e129-4e3b-a8e8-0627513a84e6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.119874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a1fbe-e129-4e3b-a8e8-0627513a84e6 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.121487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 470/922] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:09.126439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.126726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.127031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.145380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:09.146565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:09.152530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.153201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.153487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.153767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.154943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:09.155260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.157013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.164014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 453/923] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:09.169523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.227447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 471/924] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:09.244658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.271126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812444d8-a97f-466c-8349-ad070b5068f0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.306163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.307176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.307473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.307756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.308738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:09.309050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.311185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.317616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 454/925] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:09.325974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.331652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:09.347039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:09.360730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d4e52-34d6-4b7c-9251-cf14ded3799f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.400033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.401669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.402212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.402632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.403713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.405866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:09.421969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:09.423240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:09.424267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:09.431327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 472/926] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:09.433348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.448329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f2b6-a2ca-44ee-9b5c-770e07c28b9c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.486728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.487726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.488109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.488529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.489370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.490997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.523046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 455/927] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:09.547916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd57fa-59e9-4979-9005-3c8806605dab None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.593266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.593942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.594227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.594551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.595313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:09.595620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.597026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.599443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:09.604651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 473/928] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:09.612074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.693266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:09.735336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098a2f-5902-4420-a246-b6a413e3aae5 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.771165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.772278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.772820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.773347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.774273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:09.774772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.776374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.782266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 456/929] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:09.788493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:09.891664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7b88a-217c-4144-8746-58c26dd67536 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:09.926117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:09.927240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:09.927770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:09.928248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:09.929267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] RBAC: Adding query filter params (interface=public, service_id=1e22e24268de40d783a509700ffc95ed, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:09.929825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:09.931433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a37d-39bc-4b75-afc4-bd9972272e4e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:09.937508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 474/930] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/endpoints?service_id=1e22e24268de40d783a509700ffc95ed&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:09.943371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:10.055257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc050a-7cdb-4637-bbff-185c561c418d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:10.087507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:10.094649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:10.095708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.096201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.096681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.097589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:10.099221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ed4a-3671-4caf-99d8-55ac0059efce None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:10.106783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 457/931] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:09 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:30:10.331264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cca3-c64f-4c7a-950f-492e6dd67960 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.331626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cca3-c64f-4c7a-950f-492e6dd67960 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.331807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cca3-c64f-4c7a-950f-492e6dd67960 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.333412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 475/932] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:10.338996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.339292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.339568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.357011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:10.358219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:10.440275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 458/933] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:10.464030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144cca3-c64f-4c7a-950f-492e6dd67960 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:10.555283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:10.622785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144cca3-c64f-4c7a-950f-492e6dd67960 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:10.662136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:10.665607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.665607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.665607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.665607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:10.665607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:10.666980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING keystone.server.flask.common [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 20:30:10.705311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.sql.core [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 20:30:10.705311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 20:30:10.705311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [parameters: {'id': 'a5edad160fb94190aa22618b42b81c3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 20:30:10.705311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80494) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5edad160fb94190aa22618b42b81c3b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5edad160fb94190aa22618b42b81c3b. Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:30:10.724233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application result.read() Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 13 20:30:10.725156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application yield resource Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise self.value Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application session.commit() Jul 13 20:30:10.726170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self.session.flush() Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application compat.raise_( Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 20:30:10.727923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 20:30:10.729024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application result.read() Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:30:10.729802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [parameters: {'id': 'a5edad160fb94190aa22618b42b81c3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:10.730737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:10.733215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5edad160fb94190aa22618b42b81c3b. Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:10.735381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 476/934] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jul 13 20:30:10 2022] POST /identity/v3/projects => generated 262 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:10.736630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:10.845642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa8002-8fdf-4a2d-bb95-ac7e2597f4d1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:10.871547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:10.884084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604c22-c364-409d-b95d-591627935603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:10.885275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604c22-c364-409d-b95d-591627935603 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.885765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604c22-c364-409d-b95d-591627935603 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.886249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604c22-c364-409d-b95d-591627935603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.893859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604c22-c364-409d-b95d-591627935603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:10.895650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604c22-c364-409d-b95d-591627935603 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-1d604c22-c364-409d-b95d-591627935603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:10.910173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:10.911095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:10.911999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:10.914520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 459/935] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:10.920347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:10.996551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340da75-7adf-4aee-b823-5c97baad0d0e None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:10.996920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340da75-7adf-4aee-b823-5c97baad0d0e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:10.997105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340da75-7adf-4aee-b823-5c97baad0d0e None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:10.998621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 460/936] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:11.008089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.008089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.008089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.046937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:11.046937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:11.128519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3771-709d-4a9b-b58a-35b7ccae49e4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:11.168195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:11.180359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 461/937] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:11.190432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:11.191200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.191481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.191791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.193278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:11.193588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:11.195315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:11.212008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:11.218079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 477/938] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:11.337592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242b533-3db0-4d21-911a-6cfecd9a70cc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:11.355267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:11.378134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:11.379010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.379536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.380226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.392809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:11.401274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:11.402279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:11.403148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 462/939] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:11.410269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:11.527630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee196bf-9c30-425b-ad1e-fc48b4aff8fe None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:11.566881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:11.567647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.567927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.568200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.568953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:11.569255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:11.570881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:11.581151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 478/940] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:11.586507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:11.703928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8f392-91dd-4055-9639-3e9261e2d1cc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:11.740109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:11.740913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.741195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.741546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.752836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:11.754293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-1d43915a-dd9a-4b6a-acf3-bc77d09e3991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:11.771589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:11.772511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:11.773942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:11.773942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:11.773942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:11.773942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:11.773942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 463/941] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:11.779966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:11.792765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2033-788b-4a5e-8c58-b053cd548010 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.793050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2033-788b-4a5e-8c58-b053cd548010 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.793324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2033-788b-4a5e-8c58-b053cd548010 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.794709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 464/942] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:11.799671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.799961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.800242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.817476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:11.818680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:11.834939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:11.839986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:11.895272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 465/943] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:11.903167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161904c-f652-4cd0-8b9e-968cfc1aa9e1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:11.912135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:11.941079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:11.942497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:11.943085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:11.943593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:11.944554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:11.945038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:11.946864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:11.965067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 479/944] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:11.966343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.013431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e27887-b22f-449e-a645-9b3799b91ad7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.048859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.049250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.049498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.049780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.050434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.051859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:12.064271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:12.065326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:12.066151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.070749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 466/945] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:12.071676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.089883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae299-7dc4-458d-9032-6af711056f8e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.092209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.098468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.142180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.143324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.143855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.144263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.152453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.154255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:12.171231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:12.172300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:12.173291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:12.179792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b727f-81a0-4fba-9926-2c651e4972c8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.180243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 480/946] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:30:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:12.181357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.213471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.214138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.214420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.214696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.215495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:12.216135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.217435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.230330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 467/947] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:12.230982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.295919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340edf3-3c81-4010-9565-f7ea4a0ce4a8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.315742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.334239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439e0b-9b80-4b1f-af87-5dc137a83bb8 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.339129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.339900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.340284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.340637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.341546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:12.342291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.344183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9515f4d-2880-443c-833e-69ea81de8d5e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.362812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 481/948] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:12.368611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c16b-ec5f-4274-b03d-e7f4b7e61478 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.368898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c16b-ec5f-4274-b03d-e7f4b7e61478 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.369001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.369201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91c16b-ec5f-4274-b03d-e7f4b7e61478 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.369614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.369949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.370228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.374521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 482/949] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:12.374646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:12.374646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.374802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91c16b-ec5f-4274-b03d-e7f4b7e61478 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.374907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc6435-8463-4299-a2a4-32d256134fb6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.387366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 468/950] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:12.388697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.388989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.389267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.397041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.415062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:12.416700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:12.492128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91c16b-ec5f-4274-b03d-e7f4b7e61478 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.499831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 469/951] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:12.523089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.531830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.532845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.533228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.533602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.548937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.550513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:12.569460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:12.570596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:12.571518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:12.571518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:12.571518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:12.571518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:12.571518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 483/952] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:12.576261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.622747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.653071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0ce6c-42e1-44f6-b943-b2d970b10de3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.657945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.696608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5d2a2-d89d-46a5-99bc-26efbf975889 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.698275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.699919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.700206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.700485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.701148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.702533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:12.718194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:12.719412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:12.720433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:12.723005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 470/953] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:12.726490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.736459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.737286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.737718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.738081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.738893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:12.739411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.740951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.759422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 484/954] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:12.760494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.847450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680f8d-ff9c-4e88-bc9c-59eb12918bbe None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.886234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3198b0-e3de-4469-bee1-287160beceb4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:12.886524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.887316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.887712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.888137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.889035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:12.889476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.891040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.896694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 471/955] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:12.905042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:12.914408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.925934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:12.933520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:12.934739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:12.935335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:12.935814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:12.943707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:12.946064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:12.961554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:12.962595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:12.963597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:12.971067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 485/956] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:12.978107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:13.010194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82e4c0-cf02-4565-a8ae-fc7a9a467bfc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.045030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.045953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.046385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.046836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.047722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:13.048176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.049742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:13.059023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 472/957] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:13.061752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:13.090111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db704d1-b50c-4619-b864-982a1b8d7337 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.127032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.127944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.128058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.128319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.129224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:13.129641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.131165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:13.143303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:13.149713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 486/958] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:13.150688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:13.169681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278ff7-2528-4e0d-aefc-a55e4921bcde None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.207069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.208042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.208649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.209140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.210084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.211480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:13.212149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa7018-d947-4816-b761-2e29d9aef33c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:13.243591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 473/959] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:13.272929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95458d-ccde-4f4b-852f-1d6e1f2d5794 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.323013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.324057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.324335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.324608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/4dce5ff2de9342969b39fca8578fca98/roles/e01a3ff199d44e5595fa6d6290690086` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.327046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=4dce5ff2de9342969b39fca8578fca98, role_id=e01a3ff199d44e5595fa6d6290690086)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.328736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0205de-329c-4419-a79d-508c2d35d558 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:13.344833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 487/960] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:30:13 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/4dce5ff2de9342969b39fca8578fca98/roles/e01a3ff199d44e5595fa6d6290690086 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:30:13.481195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b80896-a713-4ac9-8de4-a9508d4003cd None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.481540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b80896-a713-4ac9-8de4-a9508d4003cd None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.481741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b80896-a713-4ac9-8de4-a9508d4003cd None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.483550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 474/961] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:13.489081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.489566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.490027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.508392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:13.510184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:13.589440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 488/962] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:13.614863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b80896-a713-4ac9-8de4-a9508d4003cd None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:13.739006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b80896-a713-4ac9-8de4-a9508d4003cd None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.772286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.773029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.773315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.773720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.774326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.775843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:13.777254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING keystone.server.flask.common [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 20:30:13.790654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.sql.core [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 20:30:13.790654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 20:30:13.790654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [parameters: {'user_id': 'c2e90456a28a48539b5f4e3618424b0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 20:30:13.790654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80495) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result.read() Jul 13 20:30:13.798510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:30:13.799432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application yield resource Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application next(self.gen) Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise self.value Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application session.commit() Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 20:30:13.800420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.session.flush() Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application compat.raise_( Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 20:30:13.801313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 20:30:13.802196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application conn.query(q) Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application result.read() Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 20:30:13.804117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c2e90456a28a48539b5f4e3618424b0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:13.806629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 13 20:30:13.808534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 475/963] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 13 20:30:13 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:13.813991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:13.819945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:13.887317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:13.934934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1c456-5ca0-4ed1-9e64-73c8a5db4e0c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:13.982910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:13.982910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:13.982910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:13.982910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:13.988884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:13.990368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-e970f410-0b5f-4e49-9688-66d14979eaac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:14.005076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:14.006020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:14.006970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 489/964] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:14.014095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:14.134341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38b286-a904-4755-9f41-9e39fd3b6ec7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:14.168869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:14.169549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:14.169836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:14.170112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:14.170949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:14.171256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:14.172909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ea4bd-2769-4a79-8855-4fba3784ec54 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:14.213309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 476/965] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 13 20:30:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:14.483180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6446-3168-42c0-bbdb-34a9b38a9037 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:14.483559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6446-3168-42c0-bbdb-34a9b38a9037 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:14.483766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6446-3168-42c0-bbdb-34a9b38a9037 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:14.485391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 490/966] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:14.490804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1fb0-83db-4a7c-bb82-227381e5fcf4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:14.491133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1fb0-83db-4a7c-bb82-227381e5fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:14.491442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a1fb0-83db-4a7c-bb82-227381e5fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:14.509538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-047a1fb0-83db-4a7c-bb82-227381e5fcf4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:14.511151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-047a1fb0-83db-4a7c-bb82-227381e5fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:14.557966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:14.585479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 477/967] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:14.608262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6446-3168-42c0-bbdb-34a9b38a9037 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:14.717283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:14.722317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6446-3168-42c0-bbdb-34a9b38a9037 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:14.761865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:14.762449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:14.762730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:14.763031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:14.763756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:14.765122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77d55c-d7d5-44f3-9ebe-fb284dd11b7b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:14.786946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 491/968] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:14 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:15.379587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3cb0-34ac-4014-b666-175d05ee2514 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.380132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3cb0-34ac-4014-b666-175d05ee2514 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.380132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3cb0-34ac-4014-b666-175d05ee2514 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.381567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 478/969] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:15.387269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.387681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.387846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.405111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:15.406373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:15.452647 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6802-ede7-48b3-8a9e-91cade6bb7d5 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.452980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6802-ede7-48b3-8a9e-91cade6bb7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.453209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e6802-ede7-48b3-8a9e-91cade6bb7d5 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.454832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 479/970] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:15.459454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.459794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.460018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.477504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:15.478778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:15.494119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 492/971] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:15.517345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:15.552461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 480/972] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:15.576393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:15.616166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:15.640669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6469f-b071-428f-a91f-55addb088d47 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:15.710078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:15.711223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.711507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.711780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.712441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:15.713718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842787a5-fcfc-4414-a8ba-5d5cb4364dfd None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:15.713828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:15.725625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:15.727620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:15.728491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 493/973] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:15.733025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:15.733401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:15.779388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:15.780480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.780841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.781078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.804935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:15.813552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:15.814633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:15.815560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:15.817919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 481/974] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:15.823728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:15.896960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba222-27f8-4ffa-ab01-82ecfab8b8dd None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:15.945309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:15.946611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:15.946895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:15.947198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:15.948243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:15.948548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:15.950697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:15.959802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df0b1-f30d-4e38-ab76-ac6a1b25ec73 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:15.963094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 494/975] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:15.964964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:15.987740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.000908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.001902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.002323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.002849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.003643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:16.003958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.005547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.022172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 482/976] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:16.023895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.058249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.094458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc31a3-4c24-4fa4-b81a-4b4201c3bb8d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.137718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.138746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.139501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.139876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.140674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:16.141075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.142561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.149681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 495/977] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:16.155293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.159471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea65518-899d-478f-beb0-64b21f58bce6 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.207969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.208765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.209279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.209556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.223448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.224909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:16.247158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:16.248083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:16.248942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:16.248942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:16.248942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:16.248942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:16.253288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 483/978] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:16.253641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.254145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.282567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76aa3-6b87-428d-a69e-2f76c33ff2e9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.320026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.320752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.321117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.321387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.322251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] RBAC: Adding query filter params (interface=admin, service_id=1e22e24268de40d783a509700ffc95ed, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:16.322561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.324152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.334965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 496/979] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/endpoints?service_id=1e22e24268de40d783a509700ffc95ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:16.337122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.343916 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.365031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c10d5-c65e-44bf-96ff-78c0e55341ec None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.399142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.399875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.400126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.400358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.401076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:16.401379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.402746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.419518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 484/980] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:16.420403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.479400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4568-a35d-49ca-921d-c1efd716827e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.516572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.517665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.518244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.518731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.519639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.521326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.539387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 497/981] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/services => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:30:16.540770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59112110-aa11-4c8b-91ae-39e67415eb73 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.595337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.596176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.597222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.597222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.607134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.610270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-c954ff40-a227-4d27-9124-d9bbb1143c06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:16.628664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:16.629859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 20:30:16.631031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:16.633133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 485/982] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:16.633579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.640196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.646634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:16.825125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b98d7-be0d-40be-873e-71053aa1e225 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.825491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b98d7-be0d-40be-873e-71053aa1e225 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.825699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b98d7-be0d-40be-873e-71053aa1e225 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.827493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 486/983] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:16.832356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.832643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.832911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.837094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e9bb-be88-427e-8067-fae369b3050d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:16.852899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:16.854726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:16.891532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:16.892214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:16.892470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:16.892742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:16.893585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:16.893892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:16.895373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:16.930377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 498/984] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:16.936999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:16.943947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 487/985] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:16.965866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.048247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.109596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cff50-530a-405e-8ff2-0c0d0fe102e3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.122538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf181-5732-4292-9dfa-93eed08ba088 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.168201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.172410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.175388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.175513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.176147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.176246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.176468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.176572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.176756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.177384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.178756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:17.205626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:17.206687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:17.207595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:17.209291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 488/986] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:17.215577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.271764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.276014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.366490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861c17-c778-498b-9f45-d66aeec5f085 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.376026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.410465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.411338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.411808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.412283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.413754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:17.413986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.416308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.423906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 489/987] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:17.431853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.461831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 499/988] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:17.468870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.504570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.551225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa573-a49d-48c7-b79c-bf7ebee4e979 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.583793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8379-36c8-4b4d-a584-f9ca27a3bc45 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.585885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.586597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.586877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.587179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.587886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:17.588193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.589568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.594465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 490/989] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:17.600118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.626255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.627083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.627364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.627635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.641729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.643351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:17.664302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:17.665539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:17.666637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:17.666637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:17.666637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:17.666637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:17.667845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 500/990] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:17.673723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.692539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.723106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81592be8-57a4-4c64-aa07-4abcfb7422fb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.748539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.762957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.763622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.763907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.764188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.764974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] RBAC: Adding query filter params (interface=public, service_id=605ec897cf5c4d27a9830328bd834159, region_id=RegionOne) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:17.765283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.766726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.772081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 491/991] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/endpoints?service_id=605ec897cf5c4d27a9830328bd834159&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:17.777772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.793245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e183c99-caca-451b-848a-bd9b1f1151b6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.829035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.829697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.829979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.830255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.831012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:17.831319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.832688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.849427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 501/992] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:17.851933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:17.894346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee880-bec2-461d-ad5e-200ac96d976f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:17.928691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:17.929515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:17.929782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:17.930050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:17.930735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:17.931643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:17.932520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:17.950950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 492/993] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:30:17.975376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee411841-85ab-4534-ad64-6d95bdee32b1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:18.013939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:18.014745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.015052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.015380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.023302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:18.024778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:18.041457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:18.042471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:18.043398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 502/994] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:18.052250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:18.111195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:18.178725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec5d3-ee52-48aa-ab2f-5028cafd1789 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:18.214982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:18.215686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.215967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.216240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.217021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:18.217325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:18.218759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf3f61-4e3e-4518-bc6d-29f95ffcb42e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:18.232679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 493/995] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:18.238347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:18.343406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bde52-99c7-4216-ac72-8ec662eca77a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:18.379155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:18.379797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.380071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.380342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.381161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] RBAC: Adding query filter params (role.id=e01a3ff199d44e5595fa6d6290690086, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=4dce5ff2de9342969b39fca8578fca98) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:18.381464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:18.384223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13b351-0eed-41fd-964e-f420423aa38c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:18.384822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:18.391955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 503/996] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:18 2022] GET /identity/v3/role_assignments?user.id=4dce5ff2de9342969b39fca8578fca98&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=e01a3ff199d44e5595fa6d6290690086 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:18.596689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d15a-fca7-454b-839d-e2a245a690fa None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.597217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d15a-fca7-454b-839d-e2a245a690fa None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.597217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d15a-fca7-454b-839d-e2a245a690fa None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.598739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 494/997] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:18.604927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.605370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.605485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.622086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:18.623289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:18.698184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 504/998] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:18.721381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773d15a-fca7-454b-839d-e2a245a690fa None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:18.828231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773d15a-fca7-454b-839d-e2a245a690fa None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:18.839635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:18.864135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:18.864864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:18.865144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:18.865418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:18.866071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:18.867526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:18.879500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:18.880499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:18.881410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 495/999] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 13 20:30:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:18.886999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:18.991663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ed31-0e49-4b60-898e-c8555afc20c1 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:19.019833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:19.031839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:19.032705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:19.033054 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:19.033401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:19.034192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:19.034568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:19.036077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:19.042123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 505/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:19.047936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:19.155275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b464ab-e4c8-4535-8363-1e9590501ea3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:19.188724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:19.189389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:19.189705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:19.189983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:19.190693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:19.191030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:19.192405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c9d3-1b89-465b-844b-edbcc91fcd67 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:19.197791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 496/1001] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 13 20:30:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:19.203392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:19.307303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f71ee-72f3-4ed8-8ca1-58ff5af4669e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:19.341056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:19.341716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:19.342001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:19.342281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:19.343071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:19.344452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6702-b364-4f8d-9a1f-3152861163de None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:19.363979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 506/1002] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:19.964465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c975e-286d-4269-a92b-3c57adf9c6eb None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:19.965030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c975e-286d-4269-a92b-3c57adf9c6eb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:19.965030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c975e-286d-4269-a92b-3c57adf9c6eb None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:19.966558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 497/1003] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:19.971772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:19.972209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:19.972284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:19.990037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:19.991251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:20.040131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:20.068759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 507/1004] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:20.091804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c975e-286d-4269-a92b-3c57adf9c6eb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.138095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:20.209036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c975e-286d-4269-a92b-3c57adf9c6eb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.255918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.256623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.256866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.257294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.257991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.259388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:20.271338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:20.272288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:20.278417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 498/1005] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:20.281138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.389302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74102f-c1e8-4d60-a4f9-9be9fca4506f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.432842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.433518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.433800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.434076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.434794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:20.435119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.436493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c11b32-f1f6-45ef-823c-c707745165cc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.441725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 508/1006] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:20.447691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.467730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77f8c-97e9-4ad5-a482-080c83891a78 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.468031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77f8c-97e9-4ad5-a482-080c83891a78 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.468308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77f8c-97e9-4ad5-a482-080c83891a78 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.469899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 509/1007] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:20.475396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.475706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.476045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.494438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:20.495694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:20.533618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:20.565917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e32ee-fb8c-46b5-b094-6a5abe9b82bd None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.567451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 510/1008] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:20.568038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:20.589505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.605122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.605782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.606065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.606335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.607069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:20.607374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.608752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.618361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 499/1009] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:20.619714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.696113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735056e-ec18-4e3a-84cf-d77d61141230 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.729821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8941e-159d-4d2b-8f99-fa8b6e0aa1e1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.730736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.731654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.732003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.733143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] PATH_INFO: `/v3/services/image` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.733143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.736031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:20.749190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:20.750225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:20.751112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:20.755284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 511/1010] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:20.756558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.770686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.771467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.771752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.772027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.772979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.774874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.793395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:20.806978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 500/1011] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:20.879218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b72b5e-bae0-48ce-8603-b9976e183f61 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:20.923901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:20.924602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:20.924898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:20.925174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:20.925890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] RBAC: Adding query filter params (name=image) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:20.926197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:20.927633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12bce0-0419-497a-98c4-f96a4c31ddbb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:20.933672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 512/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:20.939556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:20.969643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:21.051479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f296ea7-15bd-48a4-b7d7-cfd4bb031257 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:21.089735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:21.090416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:21.090697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:21.091039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:21.091757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] RBAC: Adding query filter params (type=image) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:21.092067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:21.093439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25dcb21-f786-495e-86f7-77430ee7e83b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:21.098259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 501/1013] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:21.402166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c6f2-20ee-438a-9dfb-31dd4432f348 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:21.402656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c6f2-20ee-438a-9dfb-31dd4432f348 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:21.402656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2c6f2-20ee-438a-9dfb-31dd4432f348 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:21.404099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 513/1014] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:21.409480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:21.409843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:21.410194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:21.427841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:21.429186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:21.505632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 502/1015] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:21.528446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2c6f2-20ee-438a-9dfb-31dd4432f348 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:21.633203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:21.640682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2c6f2-20ee-438a-9dfb-31dd4432f348 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:21.680534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:21.681332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:21.681622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:21.681897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:21.683132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:21.684558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca150124-da3f-45da-92e2-02da21693579 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:21.686436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 514/1016] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:21.693088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:21.711639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:21.797546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807940c-b2c5-4752-a917-374d7b2cc45b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:21.836717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:21.837384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:21.837674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:21.837951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:21.838680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:21.840164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9ee7d-29d1-49e5-bb11-ea8a4fcf6bc7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:21.869167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 503/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:21 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:22.931440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43e05a-112b-4a7a-b223-b52abc4f8382 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:22.931969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43e05a-112b-4a7a-b223-b52abc4f8382 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:22.931969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43e05a-112b-4a7a-b223-b52abc4f8382 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:22.933526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 515/1018] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:22.938550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783459-80f4-4515-8b53-792c43603bd6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:22.939010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783459-80f4-4515-8b53-792c43603bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:22.939185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6783459-80f4-4515-8b53-792c43603bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:22.956620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d6783459-80f4-4515-8b53-792c43603bd6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:22.957846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d6783459-80f4-4515-8b53-792c43603bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:23.027316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:23.039215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 504/1019] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:23.057866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43e05a-112b-4a7a-b223-b52abc4f8382 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.166629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43e05a-112b-4a7a-b223-b52abc4f8382 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.170023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764e69-4800-47f4-ae56-8825388e1316 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.170313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764e69-4800-47f4-ae56-8825388e1316 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.170589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df764e69-4800-47f4-ae56-8825388e1316 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.172148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 505/1020] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:23.176692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.176976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.177258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.198179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:23.199334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:23.206445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.207292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.207577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.207859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.217992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:23.226370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:23.227782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:23.228653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 516/1021] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:23.233544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.258794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:23.272078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 506/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:23.294860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.344216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa069-1dbc-419e-88cc-df1cb63f12f1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.380863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.381538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.381819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.382161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.383388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:23.383793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:23.385165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:23.398583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 517/1023] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:23.400437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.401138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27621e-71ed-4016-b8f7-8b14c736e5f7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.428610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:23.438028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.438706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.439019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.439301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.440024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:23.441405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:23.459046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 507/1024] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:23 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:23.500578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:23.521067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c75c08-50d0-4109-a8a6-ee92e9a42e01 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.575917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.576736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.577072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.577351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.590442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:23.591931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:23.611369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:23.612321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:23.613213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:23.613213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:23.613213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:23.613213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:23.613213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 518/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:23.618718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.732477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54eec-44ac-4ba8-8c05-c50d3597a78a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.769443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.770111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.770391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.770649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.771421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:23.771728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:23.773822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174a58-f9fe-4c3e-9327-1b5133bafc1c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:23.790991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 508/1026] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:23.792234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:23.907673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b44ea-fbeb-48ab-aed7-a11e321992ef None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:23.928338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3890-02f3-4281-9a5d-414b3a876dbb None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.928678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3890-02f3-4281-9a5d-414b3a876dbb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.928959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3890-02f3-4281-9a5d-414b3a876dbb None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.930352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 509/1027] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:23.935860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.936150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.936429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.947923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:23.948726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:23.949006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:23.949280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:23.954939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:23.956326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:23.957532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:23.958748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:23.960386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:23.975229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:23.976385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:23.977867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 519/1028] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:23.987006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.007979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:24.034698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 510/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:24.059809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.101839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12896f3f-c394-4141-a59f-17d7070435f8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.138634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.139421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.139715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.139992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.140850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:24.141146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.142637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.163405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 520/1030] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:30:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:24.168979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.175219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb94ec-4a6b-40ab-8220-9e02a457fea9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.213284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.214099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.214441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.214722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.215971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.217428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.219263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 511/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:24.224656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.233765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:24.281294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:24.288042 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c646-e993-4aad-a86c-8811165cda16 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.329825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.330480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.330767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.331080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.341633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99f84-70dc-4141-aebb-3b39a440a284 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.380227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.380898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.381184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.381495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.382386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.383987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.405935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 512/1032] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:30:24 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:30:24.413467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.415115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.474467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:24.530413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 521/1033] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 20:30:24.536219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.654249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdaa93-ce47-41f1-a45d-96456d82c7fd None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.657317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:24.700500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.701599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.702085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.702530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.713239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.714890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:24.733132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:24.734074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:24.735150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:24.735150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:24.735150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:24.735150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:24.736967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 513/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:24.742574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:24.848570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d49-caaa-44e9-811b-c4e4584ca9b6 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:24.884391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:24.885428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:24.885902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:24.886379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:24.887446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:24.887960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:24.889505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:24.901942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 522/1035] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:24.907401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:25.021260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781b6e-e5e5-4f14-ad0d-2eefb57deddc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:25.056844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:25.057670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.057954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.058230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.065126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:25.066570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:25.080363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:25.081269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:25.082153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:25.088166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 514/1036] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:25.088323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:25.105439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:25.197011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c008fc-6bd3-4a7b-9ca1-b9badf3b4e51 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:25.237367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:25.238032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.238310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.238585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.239410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:25.239719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:25.241139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6117dc-10b0-472a-b9d1-6dfbe647b6e4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:25.253680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 523/1037] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:25.259726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:25.276234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:25.365309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba26a94-e8cd-43e5-bdcd-878d17d8dd5a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:25.398736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:25.399433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.399719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.400002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.400831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] RBAC: Adding query filter params (role.id=e01a3ff199d44e5595fa6d6290690086, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:25.401145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:25.402583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf67fe-d5d6-4472-8f5d-c8c63845b497 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:25.408368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 515/1038] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:25 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=e01a3ff199d44e5595fa6d6290690086 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:25.531468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c267e9-99f8-4ec0-a983-ecfbcf05adba None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.531818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c267e9-99f8-4ec0-a983-ecfbcf05adba None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.532007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c267e9-99f8-4ec0-a983-ecfbcf05adba None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.533639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 524/1039] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:25.539234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.539546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.539812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.559991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:25.561194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:25.632988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 516/1040] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:25.659881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c267e9-99f8-4ec0-a983-ecfbcf05adba None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:25.739670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:25.774639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c267e9-99f8-4ec0-a983-ecfbcf05adba None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:25.809270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:25.810062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.810344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.810619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] PATH_INFO: `/v3/services/image` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.811298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:25.812666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:25.824406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:25.825413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:25.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:25.830737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 525/1041] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 13 20:30:25 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:25.831614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:25.842631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:25.938537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d371-cc36-4328-bc13-8633f5c87a99 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:25.979371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:25.980044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:25.980323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:25.980595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:25.981314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:25.981644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:25.983046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:25.993270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 517/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:25.996031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:26.100466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba270a4-f4d1-43fe-a593-b633e2fb267e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:26.136232 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:26.136896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.137176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.137454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.138152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] RBAC: Adding query filter params (type=image) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:26.138458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:26.139857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:26.142124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:26.150530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 526/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:26.151896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:26.230411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:26.264617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02fd23-fcea-4f45-9dcb-a03c6f952cf3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:26.302129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:26.302786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.303115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.303387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.304405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] RBAC: Adding query filter params (interface=public, service_id=770025adbbd744d2891bcb28e29dd17b, region_id=RegionOne) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:26.304526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:26.305859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a1bb-a721-403e-8874-593ac9c90ac2 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:26.311396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 518/1044] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:30:26 2022] GET /identity/v3/endpoints?service_id=770025adbbd744d2891bcb28e29dd17b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:26.316828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:26.425567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977a37-8411-4522-ac18-147c5038eb17 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:26.461214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:26.461874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.462154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.462526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.463225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:26.464610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a836ea-d018-4b7d-8e5f-e8e85242b1d8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:26.471859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 527/1045] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:30:26 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:30:26.494217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886894-252a-4051-8e17-ee767ccba85e None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.494428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886894-252a-4051-8e17-ee767ccba85e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.494650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886894-252a-4051-8e17-ee767ccba85e None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.496424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 519/1046] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:26.502330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.502662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.502872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.524900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:26.526214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:26.595985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:26.606303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 528/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:26.630480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886894-252a-4051-8e17-ee767ccba85e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:26.742408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886894-252a-4051-8e17-ee767ccba85e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:26.777555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:26.778272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.778564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.778841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.781834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:26.790337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:26.797940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:26.798872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:26.800030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:26.803000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 520/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:26.805607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:26.907493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7a001-a9c5-47d6-adee-835928f53ca2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:26.947081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:26.947759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:26.948035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:26.948302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:26.949052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:26.949349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:26.950703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:26.962849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 529/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:26.968673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.078024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928211a-55cf-4d0b-8780-f73e5aed2a5d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.113073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.113943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.114225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.114502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] PATH_INFO: `/v3/users/3d4a216b0ef44af5add40879e3f1320d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.128605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4a216b0ef44af5add40879e3f1320d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:27.130062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e0fe3-950c-42ff-afe5-075571b0f3c2 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:27.131972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 521/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:26 2022] GET /identity/v3/users/3d4a216b0ef44af5add40879e3f1320d => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:27.137718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.199352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:27.246628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ab2-a666-4295-81a3-011905ec507a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.283998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.284654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.284936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.285210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.356162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:27.357523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:27.413641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:27.435751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee10-31b0-4670-8836-76868cde968a None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.436282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee10-31b0-4670-8836-76868cde968a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.436282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee10-31b0-4670-8836-76868cde968a None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.437807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 522/1051] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:27.442492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.442791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.443074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.459446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:27.460730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:27.461861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 530/1052] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:27.467435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.517999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:27.537779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 523/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:27.560244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.576967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd4549-ae73-453a-a070-18e948fe8551 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.620014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.620789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.621071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.621344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.622507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:27.623958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:27.625926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 531/1054] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:27.631507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.662397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:27.679604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd4aa9-cef5-44d6-9462-292ad858fb58 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.716842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.717764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.718043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.718314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.729428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:27.738155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:27.739198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:27.740026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 524/1055] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:27.744182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63412-5a0f-45c6-af76-0f8c7322fbb3 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.745579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:27.781330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.781983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.782255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.782533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.783386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=6ce40c1e09c343d19df179e8da98e3ad, user.id=3d4a216b0ef44af5add40879e3f1320d) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:27.783841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:27.785276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:27.798039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:27.800560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 532/1056] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/role_assignments?user.id=3d4a216b0ef44af5add40879e3f1320d&scope.project.id=6ce40c1e09c343d19df179e8da98e3ad&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:27.861496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138c51-e2e3-4104-8369-00b163e5ce1b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:27.899715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:27.900331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:27.900617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:27.900905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:27.901667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:27.901974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:27.903431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:27.913251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 525/1057] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:27.919059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.013399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.026652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed94bc-578e-4a57-886b-0cc8d676dea5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.061160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.061956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.062235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.062511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.073573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.075052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:28.092691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:28.093635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:28.094526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:28.094526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:28.094526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:28.094526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:28.098715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 533/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:28.099859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.210035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce027-5009-4dfe-9041-79827feef337 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.220755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.254684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.255372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.255653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.255923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.256638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:28.256939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.258445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.274501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 526/1059] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:28.276325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.384284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b743a-f994-48e2-a413-895fb14dd701 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.418110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.418905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.419225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.419491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.427268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.428701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.432004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f5df051d-0a87-4d43-8029-a88a689bea7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:28.448527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:28.449548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:28.455547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 534/1060] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:28.457535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.517837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798756-9599-4058-9d09-f58799efd8a8 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.518107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798756-9599-4058-9d09-f58799efd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.518446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59798756-9599-4058-9d09-f58799efd8a8 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.520187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 535/1061] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:28.525362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.525841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.526124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.543273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:28.544459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:28.572255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f76e7-6122-42a8-b9b5-bade559084db None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.614068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.616146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.616146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.616146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.616430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:28.616608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.618265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.622637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 536/1062] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:28.638990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 527/1063] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:28.644882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.648527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.684874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.777182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a5ab-81ca-44c6-87f7-a00029fa25d7 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.801907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047bf62-9489-488d-baa9-10f349a2dc8a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.808394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.815635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.816435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.816716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.816994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.828267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.829707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.841630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:28.842434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:28.842719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:28.843025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] PATH_INFO: `/v3/services/image` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:28.843685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:28.845062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:28.847269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:28.848136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:28.849005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:28.849005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:28.849005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:28.849005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:28.849005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 537/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:28.854500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:28.862078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:28.863112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 20:30:28.863919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:28.867328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 528/1065] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:28.869286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:28.963121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:28.968902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac500f-eb48-4283-b516-da4de315a34b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:28.980619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc559-8bdb-4da7-9f2f-c64cfdc3d7da None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.005105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.005770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.006053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.006333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.007265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:29.007945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.009364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.015058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.015719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.016005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.016275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.017007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:29.017311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.018652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.021855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 538/1066] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:29.026953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 529/1067] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:29.028423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.029213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.073733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:29.135793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff961dd-8c58-4e28-8b73-af91ece7c39b None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.138105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5684-1d62-415b-affe-2530430577a1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.172325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.172981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.173101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.173282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.173537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.173787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.174066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.174245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:29.174340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.174549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.175967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.181425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 530/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:29.181546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.182988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.187358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:29.198213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:29.199196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:29.200114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:29.204585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 539/1069] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:29.205387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.207760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:29.302949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3c91-1768-48f9-b9b1-ef9c11191f70 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.312884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c03dd-7378-4cab-8a7f-2bbf8484a035 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.314902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:29.341577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.342184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.342466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.342742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.343523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.344895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9c447-9db7-4a83-86d2-baaf2a6604aa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.348897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.349643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.349994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.350343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.351314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:29.351694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.353548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.378947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 540/1070] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:29.379206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 531/1071] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:30:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:29.381104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.496795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c588bc-9606-4399-abf8-deda42cc71b4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:29.541555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:29.542474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.542754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.543666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/e01a3ff199d44e5595fa6d6290690086` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.546600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=8eebb29015984c98a0c6867dcb03fd71, role_id=e01a3ff199d44e5595fa6d6290690086)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:29.547653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad632-6cdf-4807-8270-e27dc7777f4c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:29.563516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 541/1072] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:30:29 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/8eebb29015984c98a0c6867dcb03fd71/roles/e01a3ff199d44e5595fa6d6290690086 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:30:29.803691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647dc7-9b91-4ece-b705-861cc78b4913 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.804291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647dc7-9b91-4ece-b705-861cc78b4913 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.804371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647dc7-9b91-4ece-b705-861cc78b4913 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.805786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 532/1073] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:29.811232 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:29.811498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:29.811795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:29.829400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:29.830555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:29.845548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:29.904187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 542/1074] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:29.926352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86647dc7-9b91-4ece-b705-861cc78b4913 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:29.999486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:30.033735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86647dc7-9b91-4ece-b705-861cc78b4913 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:30.071776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:30.072571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:30.072850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:30.073122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:30.083364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:30.091035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:30.092008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:30.092870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:30.094287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 533/1075] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:30.098406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:30.204469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc33c-77b6-4658-a236-0046c25b7d2f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:30.240368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:30.241049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:30.241338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:30.242014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:30.243014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:30.243371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:30.244749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:30.260563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 543/1076] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:30.262006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:30.371030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151454f-8a53-4f3e-b3aa-0b33dfa4f544 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:30.400730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:30.407063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:30.407940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:30.408217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:30.408491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] PATH_INFO: `/v3/users/3d4a216b0ef44af5add40879e3f1320d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:30.409676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] RBAC: Authorizing `identity:get_user(user_id=3d4a216b0ef44af5add40879e3f1320d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:30.411140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:30.412945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 534/1077] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:30 2022] GET /identity/v3/users/3d4a216b0ef44af5add40879e3f1320d => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:30.418663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:30.431652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:30.524292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9273fa-c964-4fe9-b01c-6699dd875bbc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:30.557466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:30.558322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:30.558595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:30.558865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:30.560075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:30.561505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e952-e2c4-4d72-9115-2c82cdcc3594 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:30.563438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 544/1078] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:30 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:30.570667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:30.677360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514393-995b-4b98-bd5e-17e85227d31d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:30.712623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:30.713512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:30.713793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:30.714065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad/users/3d4a216b0ef44af5add40879e3f1320d/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:30.716028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ce40c1e09c343d19df179e8da98e3ad, user_id=3d4a216b0ef44af5add40879e3f1320d, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:30.717456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08004-eacb-4642-8b67-b0bb745c1849 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:30.732286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 535/1079] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:30:30 2022] PUT /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad/users/3d4a216b0ef44af5add40879e3f1320d/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:30:31.425730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31c66-6a9a-4d83-abe6-142a2ab5f96d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.426300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31c66-6a9a-4d83-abe6-142a2ab5f96d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.426300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31c66-6a9a-4d83-abe6-142a2ab5f96d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.427786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 545/1080] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:31.433557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9d83-27ea-4ad0-960f-6827b517d525 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.434009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9d83-27ea-4ad0-960f-6827b517d525 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.434196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9d83-27ea-4ad0-960f-6827b517d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.451519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-493c9d83-27ea-4ad0-960f-6827b517d525 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:31.452711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-493c9d83-27ea-4ad0-960f-6827b517d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:31.511369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:31.525783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 536/1081] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:31.548086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31c66-6a9a-4d83-abe6-142a2ab5f96d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:31.568091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9c5cf-ab7d-41ab-96b0-28ed80d35d62 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.568382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9c5cf-ab7d-41ab-96b0-28ed80d35d62 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.568690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9c5cf-ab7d-41ab-96b0-28ed80d35d62 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.570120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 537/1082] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:30:31.576617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.576911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.577451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.597651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:31.598837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:31.634161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:31.667086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31c66-6a9a-4d83-abe6-142a2ab5f96d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:31.689109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 538/1083] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:31.709652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:31.710424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.710706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.711339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.712499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:31.789882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:31.791543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:31.837423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d11db6-e70d-4149-ab12-7b4926b4f7d8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:31.872564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:31.897744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:31.900696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:31.900696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:31.900696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:31.903023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:31.914273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:31.925548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:31.926496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 20:30:31.927360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:31.931070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 539/1084] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 13 20:30:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:31.934417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 546/1085] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:31.935366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:31.941508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.063879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388bc1e-22ce-4ce9-b475-9b2c1f1b38a3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.074196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8977-1a9a-4f37-8fd1-ccc0f6558b0e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.112517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.113199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.113489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.113770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.114854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:32.115248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.117555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.121268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.122061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.122340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.122608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.129849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 540/1086] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:30:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:32.135391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.135727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.137739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:32.160465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:32.161429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:32.162301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:32.162301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:32.162301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:32.162301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:32.164479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 547/1087] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:32.172675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.191119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.215883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.264869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966e82-bff1-469e-85f2-ac0036b12aac None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.308539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.309349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.309636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.309915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.312314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f9483-92a5-496e-9aad-15839aae4440 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.322292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.323896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:32.342871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:32.343829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:32.344776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:32.344776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:32.344776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:32.344776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:32.344776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 541/1088] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:32.349926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.354829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.355527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.355810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.356100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.356834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:32.357130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.358491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.385349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 548/1089] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:32.474413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.484982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347e87-f8fd-4bb4-8e7f-7b593183e271 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.526370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.527448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.527940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.528418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.529495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:32.530034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.531737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c51a3-b1b6-44e4-911a-1aec225b80ec None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.546220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 542/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:32.555092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.681665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.697769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c492-1c0a-4383-a157-ba1c850f6b91 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.734484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.735238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.735524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.735796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.745395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.746835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:30:32.761581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:32.762564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 20:30:32.766527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:32.767094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195e6e-7f16-4bb7-8295-1b6c2d97c13f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.767094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195e6e-7f16-4bb7-8295-1b6c2d97c13f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.767222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 549/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:32.767300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195e6e-7f16-4bb7-8295-1b6c2d97c13f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.767300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 543/1092] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:32.768670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.770136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.770424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.770697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.790163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:32.791459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:32.871184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 544/1093] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:32.876243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304b28-d78a-4aef-9084-955226416965 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:32.887008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.914072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:32.914746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:32.915058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:32.915334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:32.916172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:32.916479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:32.917917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:32.936178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 550/1094] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:32.941628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:32.953461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.975393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:32.997746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eafdeb-a46d-423e-94f6-d9378978866e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.034009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.034817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.035310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.035595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.046326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:33.053516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5000874-8340-432f-9d19-7f3aafb3729d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:33.054094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:33.055054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:33.055890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 545/1095] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:33.063685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.094120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.094798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.095105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.095383 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.168477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.169947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.173885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18fd6a-f28a-46ac-8c48-4a2ca5b54df0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.180288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.211060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.211742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.212024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.212650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.213411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:33.214021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.215727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.224586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 546/1096] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:33.232036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.241773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.277761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 551/1097] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 20:30:33.283223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.345663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae565e7a-c359-44ea-a1e2-ea1849617ae1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.381655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.383032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.383611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.383905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] PATH_INFO: `/v3/users/3d4a216b0ef44af5add40879e3f1320d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.385132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] RBAC: Authorizing `identity:get_user(user_id=3d4a216b0ef44af5add40879e3f1320d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.386658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.388372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 547/1098] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/users/3d4a216b0ef44af5add40879e3f1320d => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:33.389130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a628b-8d64-4aee-bee4-0be691d2f752 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.394147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.400704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.435323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.436139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.436402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.436675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.448400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.449856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:30:33.468963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:33.469896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:33.470861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:30:33.470861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:30:33.470861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:30:33.470861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:33.470861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 552/1099] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:33.475992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.484906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.514252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8689ef-ef99-4be9-acfb-218a79d93062 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.550204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.550782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.551104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.551374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.583105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bec-12b2-438b-90d8-e0447d5116b9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.620425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.621089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.621369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.621632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.622453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:33.622760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.624262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.626657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.628363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.636530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 553/1100] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:33.636530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.666371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.710770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.740051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 548/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:33.745843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.759200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3bf3-a713-44d8-841d-985474cb27d1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.797002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.797805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.798086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.798361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.805435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.806837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:30:33.821188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:33.822162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:33.823153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 554/1102] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:30:33.828376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.856168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973e4a-900b-417b-ae65-135996515ba1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.899447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.900324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.900612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.900891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.902151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.903825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.905688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 549/1103] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:33.912247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:33.922211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.943566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43b578-24ac-4ba0-8863-e2c1163d357d None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:33.962648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:33.982708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:33.983399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:33.983682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:33.983954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:33.984740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:33.985047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:33.986481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:33.999491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 555/1104] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:34.005903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:34.026904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f2c6-fe9d-47d3-be18-3c8d41a15dca None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:34.065875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:34.066476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:34.066765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:34.067091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:34.067938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=6ce40c1e09c343d19df179e8da98e3ad, user.id=3d4a216b0ef44af5add40879e3f1320d) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:34.068255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:34.069762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981719e9-f69e-43b9-8452-f32431fd8a8f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:34.076144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 550/1105] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:33 2022] GET /identity/v3/role_assignments?user.id=3d4a216b0ef44af5add40879e3f1320d&scope.project.id=6ce40c1e09c343d19df179e8da98e3ad&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:34.112846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60e6a-99fc-4f2a-b4c7-d2164e04b789 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:34.151475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:34.152148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:34.152433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:34.152708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:34.153563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] RBAC: Adding query filter params (role.id=e01a3ff199d44e5595fa6d6290690086, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=8eebb29015984c98a0c6867dcb03fd71) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:34.153874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:34.155577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281697-9a83-4544-b8de-74b67015ae4f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:34.162865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 556/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:34 2022] GET /identity/v3/role_assignments?user.id=8eebb29015984c98a0c6867dcb03fd71&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=e01a3ff199d44e5595fa6d6290690086 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:30:36.153183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e894-a6bb-4e23-9920-168f66ead897 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:36.153726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e894-a6bb-4e23-9920-168f66ead897 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:36.153726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e894-a6bb-4e23-9920-168f66ead897 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:36.155172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 551/1107] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:36.160734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:36.161155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:36.161241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:36.167842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:36.179584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:36.180799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:36.251194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 557/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:36.276949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298e894-a6bb-4e23-9920-168f66ead897 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:36.388680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298e894-a6bb-4e23-9920-168f66ead897 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:36.396936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:36.424799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:36.425530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:36.425831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:36.426106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:36.427313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:36.428795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0135ad-af62-46f2-a710-efa655c2543c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:36.431035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 552/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:36.436981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:36.538740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2adcf-095c-47e5-872d-1e674d5b272d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:36.574038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:36.574712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:36.575023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:36.575300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:36.576025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:36.577463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538200-3d29-4039-bcc0-8025ac010eec None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:36.584511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:36.600032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 558/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:30:36 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:38.671844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675341-d160-41ab-9c92-fff5cf1fff6d None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:38.672368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675341-d160-41ab-9c92-fff5cf1fff6d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:38.672368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675341-d160-41ab-9c92-fff5cf1fff6d None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:38.673731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 553/1111] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:38.681274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:38.681274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:38.681274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:38.697442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:38.698739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:38.766641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 559/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:38.790203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a675341-d160-41ab-9c92-fff5cf1fff6d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:38.904121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a675341-d160-41ab-9c92-fff5cf1fff6d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:38.938739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:38.939656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:38.939934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:38.940205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] PATH_INFO: `/v3/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:38.941648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] RBAC: Authorizing `identity:get_role(role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:38.943056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:38.944444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 554/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:38 2022] GET /identity/v3/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:38.950549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:39.050947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae96f-0696-40a5-830b-e18ec9b93b16 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:39.070431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:39.087237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:39.088101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:39.088382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:39.088680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] PATH_INFO: `/v3/users/437cac0f8cb64c8dbc7d82aa041075be` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:39.103475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=437cac0f8cb64c8dbc7d82aa041075be)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:39.104916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:39.111462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 560/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:38 2022] GET /identity/v3/users/437cac0f8cb64c8dbc7d82aa041075be => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:39.112364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:39.157559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:39.214195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eea71-c230-4637-98f7-d612c25e5e55 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:39.249179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2799065-6346-4818-b385-94366b1befee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:39.250066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799065-6346-4818-b385-94366b1befee None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:39.250530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799065-6346-4818-b385-94366b1befee None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:39.250804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799065-6346-4818-b385-94366b1befee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:39.320827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799065-6346-4818-b385-94366b1befee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:39.322294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799065-6346-4818-b385-94366b1befee None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:39.364426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:39.419981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:39.425906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:39.525893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478290-2654-4338-8abb-6ca58f74a5d8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:39.561715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:39.562541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:39.562830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:39.563133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:39.564351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:39.565797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e41e-a403-4d1a-a7cf-43a6f5409491 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:39.567675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 561/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:39 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:39.573713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2799065-6346-4818-b385-94366b1befee None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:39.674429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2799065-6346-4818-b385-94366b1befee None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:39.710863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:39.711480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:39.711766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:39.712045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:39.712874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=6ce40c1e09c343d19df179e8da98e3ad, user.id=437cac0f8cb64c8dbc7d82aa041075be) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:39.713189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:39.714627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c558f5-18e4-45a3-b0b3-f604d8fed018 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:39.719990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 556/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:39 2022] GET /identity/v3/role_assignments?user.id=437cac0f8cb64c8dbc7d82aa041075be&scope.project.id=6ce40c1e09c343d19df179e8da98e3ad&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:41.682340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ac46-5019-40f3-9955-5f065ffcb21d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:41.682825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ac46-5019-40f3-9955-5f065ffcb21d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:41.682949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ac46-5019-40f3-9955-5f065ffcb21d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:41.685040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 562/1118] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:41.693752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515e992-faed-48ea-8953-f70922faf621 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:41.694173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515e992-faed-48ea-8953-f70922faf621 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:41.694354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515e992-faed-48ea-8953-f70922faf621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:41.708046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:41.713869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5515e992-faed-48ea-8953-f70922faf621 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:41.715100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5515e992-faed-48ea-8953-f70922faf621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:41.791161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 557/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:41.819268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ac46-5019-40f3-9955-5f065ffcb21d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:41.877031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:41.943082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ac46-5019-40f3-9955-5f065ffcb21d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:41.981138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:41.981977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:41.982249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:41.982519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] PATH_INFO: `/v3/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:41.984087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] RBAC: Authorizing `identity:get_role(role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:41.985447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:41.986816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 563/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:41 2022] GET /identity/v3/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:41.993367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515e992-faed-48ea-8953-f70922faf621 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:42.100371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515e992-faed-48ea-8953-f70922faf621 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:42.139426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:42.140295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:42.140609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:42.140886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] PATH_INFO: `/v3/users/437cac0f8cb64c8dbc7d82aa041075be` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:42.142129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] RBAC: Authorizing `identity:get_user(user_id=437cac0f8cb64c8dbc7d82aa041075be)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:42.143613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:42.145252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 558/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:41 2022] GET /identity/v3/users/437cac0f8cb64c8dbc7d82aa041075be => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:42.152234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:42.269932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f0de-905d-48cf-b3c8-0b0470d2c9b5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:42.286068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:42.320639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:42.321482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:42.321761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:42.322037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:42.323370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:42.324798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537b0d3-bcf8-4ef5-9d19-e0d3502ae1fe None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:42.326473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 564/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:42 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:42.333669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:42.339793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:42.447025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a4261-863b-4846-a971-9b28a6da6870 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:42.483141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:42.484036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:42.484314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:42.484591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad/users/437cac0f8cb64c8dbc7d82aa041075be/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:42.487014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ce40c1e09c343d19df179e8da98e3ad, user_id=437cac0f8cb64c8dbc7d82aa041075be, role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:42.488461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60d6ec-3fb8-4328-a52e-be3d50cd71a2 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:42.504827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 559/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:30:42 2022] PUT /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad/users/437cac0f8cb64c8dbc7d82aa041075be/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:30:44.522758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deb89-2824-4b3e-a299-767a20ecba85 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:44.523462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deb89-2824-4b3e-a299-767a20ecba85 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:44.523462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deb89-2824-4b3e-a299-767a20ecba85 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:44.524811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 565/1124] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:44.531155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:44.531903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:44.532034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:44.553441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:44.554831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:44.618685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:44.628405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 560/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:44.654211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852deb89-2824-4b3e-a299-767a20ecba85 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:44.765163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852deb89-2824-4b3e-a299-767a20ecba85 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:44.799766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:44.800535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:44.800813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:44.801082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] PATH_INFO: `/v3/roles/c7a5bd97990f4340ac6ae140955e61a1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:44.802597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] RBAC: Authorizing `identity:get_role(role_id=c7a5bd97990f4340ac6ae140955e61a1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:44.804207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:44.805578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 566/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:44 2022] GET /identity/v3/roles/c7a5bd97990f4340ac6ae140955e61a1 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:44.814533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:44.928193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b78a5e-f19a-4902-8b11-ad5c2e401de1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:44.963074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:44.963940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:44.964226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:44.964506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] PATH_INFO: `/v3/users/437cac0f8cb64c8dbc7d82aa041075be` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:44.965745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] RBAC: Authorizing `identity:get_user(user_id=437cac0f8cb64c8dbc7d82aa041075be)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:44.967219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:44.968846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 561/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:44 2022] GET /identity/v3/users/437cac0f8cb64c8dbc7d82aa041075be => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:44.974721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:45.031441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:45.093996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336278-2a2e-49f3-83c9-36f50b711b6c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:45.135015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:45.135662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:45.135940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:45.136216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:45.208886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:45.210381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:45.259593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:45.314128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 567/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:45.320760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:45.397739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:45.437423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a614e98-b2d9-4f9d-87cd-767ab9d79aee None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:45.474380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:45.475268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:45.475555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:45.475911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] PATH_INFO: `/v3/projects/6ce40c1e09c343d19df179e8da98e3ad` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:45.477167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] RBAC: Authorizing `identity:get_project(project_id=6ce40c1e09c343d19df179e8da98e3ad)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:45.478956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378c0ec-14a3-4da0-8f6a-ce6e243faa1d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:45.480659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 562/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:45 2022] GET /identity/v3/projects/6ce40c1e09c343d19df179e8da98e3ad => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:45.487709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:45.591593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd1193-e079-4c7a-b7a3-34f40a2d5e31 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:45.626225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:45.626856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:45.627170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:45.627444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:45.628274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] RBAC: Adding query filter params (role.id=c7a5bd97990f4340ac6ae140955e61a1, scope.project.id=6ce40c1e09c343d19df179e8da98e3ad, user.id=437cac0f8cb64c8dbc7d82aa041075be) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:45.628584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:45.630009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d923e-ab78-4ef3-957b-34c0d974c6ac None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:45.635970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 568/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:45 2022] GET /identity/v3/role_assignments?user.id=437cac0f8cb64c8dbc7d82aa041075be&scope.project.id=6ce40c1e09c343d19df179e8da98e3ad&role.id=c7a5bd97990f4340ac6ae140955e61a1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:47.637418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9fbe-3180-48a7-842e-f48cc0e25cd3 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:47.638257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9fbe-3180-48a7-842e-f48cc0e25cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:47.638257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9fbe-3180-48a7-842e-f48cc0e25cd3 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:47.640576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 563/1131] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:47.649025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:47.649421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:47.649575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:47.668300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:47.669512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:47.683467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:47.749843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 569/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:47.774063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9fbe-3180-48a7-842e-f48cc0e25cd3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:47.886933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9fbe-3180-48a7-842e-f48cc0e25cd3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:47.921706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:47.931221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:47.932011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:47.932290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:47.932561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:47.933838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:47.935324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229edf29-a500-4f55-8f0c-7596a865c32e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:47.936952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 564/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:47.943511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:48.055791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286b69-a8b9-4734-a6c6-52b31df9e052 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:48.091441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:48.092100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:48.092376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:48.092649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:48.093349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:48.094782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd669da5-8067-4571-9033-76ac1249b042 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:48.110640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:48.126971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 570/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:30:47 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:50.149471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9a9e-686f-4ef3-b6bd-7cd325bc3b6c None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:50.150313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9a9e-686f-4ef3-b6bd-7cd325bc3b6c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:50.150313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de9a9e-686f-4ef3-b6bd-7cd325bc3b6c None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:50.152570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 565/1135] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:50.161242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:50.161649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:50.161858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:50.188647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:50.189837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:50.263681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 571/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:50.289019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de9a9e-686f-4ef3-b6bd-7cd325bc3b6c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:50.410371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de9a9e-686f-4ef3-b6bd-7cd325bc3b6c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:50.451672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:50.452470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:50.452752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:50.453028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:50.454270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:50.455808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c1634-f819-4387-87d6-d09b9117f6bd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:50.457473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 566/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:30:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:50.463635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:50.567325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c7c4-55b6-4a81-b731-2fa6891d54ee None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:50.593376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:50.603976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:50.604639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:50.604928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:50.605201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:50.605912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:50.607393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f8d57-eebb-4f2d-9d58-b86fa5b1a7fc None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:50.631706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 572/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:30:50 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:30:52.716625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7851-adf3-4581-b552-fb6835b67918 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:52.717181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7851-adf3-4581-b552-fb6835b67918 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:52.717181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7851-adf3-4581-b552-fb6835b67918 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:52.719460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 567/1139] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:52.727544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:52.728239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:52.728429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:52.746288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:52.747514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:52.821326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 573/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:52.844927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7851-adf3-4581-b552-fb6835b67918 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:52.923621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:52.962834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7851-adf3-4581-b552-fb6835b67918 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:52.997923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:52.998697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:52.999013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:52.999276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.010053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:53.017481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:53.018583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:53.019535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 568/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:53.024829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:53.132156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969c853-286e-4f18-a719-cd9ae3350242 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:53.145675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:53.170041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:53.170689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:53.170956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:53.171259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.172002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:53.172305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:53.173739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:53.183426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 574/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:53.189365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:53.293924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afb05-476e-49ef-84b6-8167e5e0f803 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:53.319192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:53.329293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:53.330264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:53.330530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:53.330818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] PATH_INFO: `/v3/users/c70536133d5f4e3c8e9482b493e1d675` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.345472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] RBAC: Authorizing `identity:get_user(user_id=c70536133d5f4e3c8e9482b493e1d675)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:53.346937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:53.348595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 569/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:53 2022] GET /identity/v3/users/c70536133d5f4e3c8e9482b493e1d675 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:53.355639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:53.455553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbfa7-41a2-4760-8f14-37b04f6165f2 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:53.489636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:53.490257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:53.490536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:53.490803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.533395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:53.559014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:53.560455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:53.665830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 575/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:53.672512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:53.784938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983112e-38d5-4838-b9e8-996183d0a977 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:53.819989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:53.820873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:53.821163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:53.821434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] PATH_INFO: `/v3/projects/51f705aeaf724f449dc8372b577c5ef1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.822731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] RBAC: Authorizing `identity:get_project(project_id=51f705aeaf724f449dc8372b577c5ef1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:53.824202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b6f51-973e-4921-8702-d4d9a5cb9a11 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:53.825900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 570/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:53 2022] GET /identity/v3/projects/51f705aeaf724f449dc8372b577c5ef1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:53.832281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:53.912424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:53.938647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb051-ab60-4a7d-aeee-595ec3e5d4cb None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:53.973921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:53.974563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:53.974841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:53.975146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:53.976181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=51f705aeaf724f449dc8372b577c5ef1, user.id=c70536133d5f4e3c8e9482b493e1d675) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:53.976318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:53.977744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994c348-28d8-4291-ac70-4f7af3b8f815 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:53.983654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 576/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:30:53 2022] GET /identity/v3/role_assignments?user.id=c70536133d5f4e3c8e9482b493e1d675&scope.project.id=51f705aeaf724f449dc8372b577c5ef1&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:55.954030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42fc4-7d28-42c1-9908-5ef5bbf2ce1c None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:55.954880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42fc4-7d28-42c1-9908-5ef5bbf2ce1c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:55.954880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b42fc4-7d28-42c1-9908-5ef5bbf2ce1c None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:55.957250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 571/1147] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:55.965949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:55.966381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:55.966501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:55.983822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:55.985010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:56.054737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 577/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:30:56.077163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b42fc4-7d28-42c1-9908-5ef5bbf2ce1c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:56.138654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:56.203439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b42fc4-7d28-42c1-9908-5ef5bbf2ce1c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:56.242984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:56.243701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:56.243980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:56.244261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:56.259222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:56.266745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:56.267858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:30:56.268835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 572/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:56.275241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:56.348337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:56.387769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988259-c566-4ad7-8ec0-36f258d7b8ac None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:56.424203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:56.424850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:56.425132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:56.425400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:56.426140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:56.426442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:56.427844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:56.436376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 578/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:56.442512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:56.557675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7057673-56c3-4533-81aa-5ef972de3859 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:56.572228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:56.605998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:56.606874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:56.607196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:56.607477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] PATH_INFO: `/v3/users/c70536133d5f4e3c8e9482b493e1d675` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:56.608735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] RBAC: Authorizing `identity:get_user(user_id=c70536133d5f4e3c8e9482b493e1d675)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:56.610184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:56.611862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 573/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:56 2022] GET /identity/v3/users/c70536133d5f4e3c8e9482b493e1d675 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:56.618887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:56.728704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fccddf-e2e4-434f-865a-a595d92efc10 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:56.759111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:56.766225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:56.767147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:56.767430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:56.767710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] PATH_INFO: `/v3/projects/51f705aeaf724f449dc8372b577c5ef1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:56.769022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] RBAC: Authorizing `identity:get_project(project_id=51f705aeaf724f449dc8372b577c5ef1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:56.770466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64275c3-c969-46c5-b987-e767a8ba292e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:56.772220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 579/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:56 2022] GET /identity/v3/projects/51f705aeaf724f449dc8372b577c5ef1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:56.778673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:56.883856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729d4e-e443-48bf-9abd-ab0a8a6f4131 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:56.919966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:56.920837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:56.921112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:56.921384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] PATH_INFO: `/v3/projects/51f705aeaf724f449dc8372b577c5ef1/users/c70536133d5f4e3c8e9482b493e1d675/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:56.923506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] RBAC: Authorizing `identity:create_grant(project_id=51f705aeaf724f449dc8372b577c5ef1, user_id=c70536133d5f4e3c8e9482b493e1d675, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:56.924932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647d1e-658c-4c79-94e3-ff97806c852a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:56.941231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 574/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:30:56 2022] PUT /identity/v3/projects/51f705aeaf724f449dc8372b577c5ef1/users/c70536133d5f4e3c8e9482b493e1d675/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:30:58.950061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbdbe-f6a7-4ea0-926c-f8c4f7db96b7 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:58.950613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbdbe-f6a7-4ea0-926c-f8c4f7db96b7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:58.950613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbdbe-f6a7-4ea0-926c-f8c4f7db96b7 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:58.952755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 580/1154] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:30:58.958503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:58.958954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:58.959112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:58.981127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:30:58.982984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:30:59.023062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:59.060749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 575/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:30:59.093803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbdbe-f6a7-4ea0-926c-f8c4f7db96b7 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:59.218055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbdbe-f6a7-4ea0-926c-f8c4f7db96b7 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:59.254586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:59.255401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:59.255681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:59.255955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:59.267247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:30:59.276118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:30:59.277809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:30:59.279045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 581/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:30:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:30:59.286233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:59.397201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9a3f9-b594-4c06-a56f-162964429718 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:59.434260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:59.434955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:59.435249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:59.435525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:59.436273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:30:59.436582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:59.437968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:59.446318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 576/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:30:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:59.452608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:59.518972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:59.566523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7557-1531-41af-a9d8-c4f863affd30 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:59.604530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:59.605519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:59.605795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:59.606066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] PATH_INFO: `/v3/users/c70536133d5f4e3c8e9482b493e1d675` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:59.607321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] RBAC: Authorizing `identity:get_user(user_id=c70536133d5f4e3c8e9482b493e1d675)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:59.608743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:59.610353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 582/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:30:59 2022] GET /identity/v3/users/c70536133d5f4e3c8e9482b493e1d675 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:30:59.617003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:30:59.654170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:59.739644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a76d-01af-491e-9295-66163e5c64be None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:30:59.777761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:30:59.778597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:30:59.778982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:30:59.779309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:30:59.859813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:30:59.861290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:30:59.891614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:30:59.964853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 577/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:30:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:30:59.974266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:00.077064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b74df-ee20-4307-b6b6-046e51649e25 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:00.104659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:00.119241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:00.120507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:00.120870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:00.121216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] PATH_INFO: `/v3/projects/51f705aeaf724f449dc8372b577c5ef1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:00.123330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=51f705aeaf724f449dc8372b577c5ef1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:00.125528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2eadd-66fd-4414-803e-17670cdec9b5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:00.128236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 583/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:30:59 2022] GET /identity/v3/projects/51f705aeaf724f449dc8372b577c5ef1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:00.134563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:00.249339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5661-6878-4008-81c7-8af0e80af709 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:00.279353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:00.285148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:00.285794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:00.286078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:00.286355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:00.287221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=51f705aeaf724f449dc8372b577c5ef1, user.id=c70536133d5f4e3c8e9482b493e1d675) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:00.287534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:00.289009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5e294-e4f3-4eae-8d6d-618669c3c5bd None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:00.294940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 578/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:31:00 2022] GET /identity/v3/role_assignments?user.id=c70536133d5f4e3c8e9482b493e1d675&scope.project.id=51f705aeaf724f449dc8372b577c5ef1&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:02.312093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d04a9-f922-4eb9-aa8b-92c08d95363e None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:02.312643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d04a9-f922-4eb9-aa8b-92c08d95363e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:02.312643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d04a9-f922-4eb9-aa8b-92c08d95363e None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:02.314050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 584/1162] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:31:02.320551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:02.321303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:02.321441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:02.341040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:02.342242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:02.411557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 579/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:02.434183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d04a9-f922-4eb9-aa8b-92c08d95363e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:02.547095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d04a9-f922-4eb9-aa8b-92c08d95363e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:02.581952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:02.582521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:02.582801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:02.583095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:02.644557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:02.652930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:02.654403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:02.762882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 585/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:31:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:31:02.772785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:02.876477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073c68f-984c-4826-84a0-026ba99b7893 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:02.902337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:02.911403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:02.912190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:02.912474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:02.912750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:02.919555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:02.920996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-798dff3f-75ba-485b-9b06-8026fd95e3d5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:31:02.935098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:31:02.936216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:31:02.937248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 580/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:31:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:31:02.944427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:03.045162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:03.052188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda92186-a519-4b2e-816c-532ad60ae385 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:03.088494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:03.089137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:03.089412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:03.089692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:03.090409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:03.090714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:03.092122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea7724-4eec-459a-8365-2cd650ae07ee None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:03.099313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 586/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 13 20:31:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:05.069353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031c0d-48a1-44f4-a8dc-c7e5d84d7fe7 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:05.070488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031c0d-48a1-44f4-a8dc-c7e5d84d7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:05.070488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031c0d-48a1-44f4-a8dc-c7e5d84d7fe7 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:05.072606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 581/1167] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:05.078842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833982-a314-4bc1-93e0-ebff509ad027 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:05.079285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833982-a314-4bc1-93e0-ebff509ad027 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:05.079445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833982-a314-4bc1-93e0-ebff509ad027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:05.099619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a8833982-a314-4bc1-93e0-ebff509ad027 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:05.100822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a8833982-a314-4bc1-93e0-ebff509ad027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:05.182974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 587/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:05.205751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031c0d-48a1-44f4-a8dc-c7e5d84d7fe7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:05.313415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031c0d-48a1-44f4-a8dc-c7e5d84d7fe7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:05.348182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:05.348759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:05.349048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:05.349327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:05.350057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:05.351516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97187-459d-49dc-97f0-d25e42210cfa None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:05.368514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 582/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Jul 13 20:31:05 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:31:07.450844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97c4b-381b-4af2-8391-75bd64471716 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:07.451427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97c4b-381b-4af2-8391-75bd64471716 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:07.451427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97c4b-381b-4af2-8391-75bd64471716 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:07.452830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 588/1170] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:07.459270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:07.459984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:07.460204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:07.479978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:07.481162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:07.527229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:07.553810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 583/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:07.578053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a97c4b-381b-4af2-8391-75bd64471716 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:07.687429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:07.703422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a97c4b-381b-4af2-8391-75bd64471716 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:07.743243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:07.744419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:07.744914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:07.745368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] PATH_INFO: `/v3/domains/e451d1e896f94443bc77d611c15dbeaf` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:07.758777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] RBAC: Authorizing `identity:get_domain(domain_id=e451d1e896f94443bc77d611c15dbeaf)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:07.760282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9572f-d949-42bf-b00f-c1424686315e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:07.762023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 589/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jul 13 20:31:07 2022] GET /identity/v3/domains/e451d1e896f94443bc77d611c15dbeaf => generated 267 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:07.768377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:07.870960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec178-a9de-4e6e-a00b-225eb8d05a93 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:07.907632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:07.908338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:07.908566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:07.908841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:07.909541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:07.911000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9320-6d6b-40a9-ae42-4ce90c80208a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:07.936847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 584/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:31:07 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:31:10.004544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d3a9-3f5c-4cda-9c9e-7a26eb394bd5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:10.005478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d3a9-3f5c-4cda-9c9e-7a26eb394bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:10.005478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d3a9-3f5c-4cda-9c9e-7a26eb394bd5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:10.007582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 590/1174] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:10.016108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da74c-363e-463c-83c1-782eececd70b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:10.016542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da74c-363e-463c-83c1-782eececd70b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:10.016691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da74c-363e-463c-83c1-782eececd70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:10.042489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-790da74c-363e-463c-83c1-782eececd70b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:10.043761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-790da74c-363e-463c-83c1-782eececd70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:10.071051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:10.132144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 585/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:10.159173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d3a9-3f5c-4cda-9c9e-7a26eb394bd5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:10.299728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d3a9-3f5c-4cda-9c9e-7a26eb394bd5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:10.334122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:10.335047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:10.335360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:10.335847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] PATH_INFO: `/v3/domains/e451d1e896f94443bc77d611c15dbeaf` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:10.337032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e451d1e896f94443bc77d611c15dbeaf)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:10.338461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d17c-d011-41f3-9979-93b69ff56f31 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:10.340129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 591/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jul 13 20:31:10 2022] GET /identity/v3/domains/e451d1e896f94443bc77d611c15dbeaf => generated 267 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:10.346171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da74c-363e-463c-83c1-782eececd70b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:10.447310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da74c-363e-463c-83c1-782eececd70b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:10.482767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:10.483438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:10.483721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:10.483986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:10.484688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:10.486123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629cbb0-0961-4004-a35a-7816b7c2ae61 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:10.509458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 586/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:31:10 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:31:12.555000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8f05-667a-4fec-a4dd-55d60ef4f432 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:12.555597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8f05-667a-4fec-a4dd-55d60ef4f432 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:12.555597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8f05-667a-4fec-a4dd-55d60ef4f432 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:12.556962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 592/1178] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:12.563524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:12.564176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:12.564374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:12.592266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:12.593468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:12.604025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:12.667765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 587/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:12.691470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8f05-667a-4fec-a4dd-55d60ef4f432 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:12.712125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:12.807959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8f05-667a-4fec-a4dd-55d60ef4f432 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:12.851713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:12.852492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:12.852773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:12.853043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:12.863509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:31:12.871184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:31:12.872389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:31:12.873359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 593/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:31:12.878729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:12.981579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1c3b8-b1d6-443b-8f42-e661a7fe43be None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:13.018093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:13.018743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:13.019050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:13.019326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:13.020068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:13.020376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:13.021742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:13.029817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 588/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:13.035917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:13.114046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:13.138215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c791d-66fe-49f4-af8a-810cb06ecc8f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:13.171690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:13.172547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:13.172827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:13.173098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] PATH_INFO: `/v3/users/f082de56c6ff4d1ea416914d5e074e2b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:13.186396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] RBAC: Authorizing `identity:get_user(user_id=f082de56c6ff4d1ea416914d5e074e2b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:13.187861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:13.189477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 594/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:31:13 2022] GET /identity/v3/users/f082de56c6ff4d1ea416914d5e074e2b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:13.195492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:13.205128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:13.308869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b852b6b-cb7a-46a1-be61-426c97b312d9 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:13.347684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:13.348634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:13.349013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:13.349443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:13.424603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:13.425988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:13.433764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:13.532346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 589/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:31:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:31:13.541045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:13.654724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae4bcc-793c-461b-9195-46d7cad9359c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:13.701060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:13.701918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:13.702201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:13.702469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] PATH_INFO: `/v3/projects/1bb3b040577d43c9a132663666358f60` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:13.703751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] RBAC: Authorizing `identity:get_project(project_id=1bb3b040577d43c9a132663666358f60)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:13.705174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a881bd-b052-4594-a923-54e6dfa83597 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:13.706877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 595/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:31:13 2022] GET /identity/v3/projects/1bb3b040577d43c9a132663666358f60 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:13.713706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:13.834957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ceff-a2ff-49e7-a139-80e44baf5957 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:13.848318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:13.880126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:13.881029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:13.881394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:13.881750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:13.882716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=1bb3b040577d43c9a132663666358f60, user.id=f082de56c6ff4d1ea416914d5e074e2b) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:13.883065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:13.884614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8c736-2ba7-4477-967f-7ec82ff38e2f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:13.890652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 590/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:31:13 2022] GET /identity/v3/role_assignments?user.id=f082de56c6ff4d1ea416914d5e074e2b&scope.project.id=1bb3b040577d43c9a132663666358f60&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:15.858522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cf3a-7f5a-4888-8b11-bf5efef8a1f5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:15.859096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cf3a-7f5a-4888-8b11-bf5efef8a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:15.859096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cf3a-7f5a-4888-8b11-bf5efef8a1f5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:15.860483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 596/1186] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:15.866966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:15.867414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:15.867535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:15.890613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:15.891838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:15.962765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 591/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:15.986217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852cf3a-7f5a-4888-8b11-bf5efef8a1f5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:15.991094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:16.100031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852cf3a-7f5a-4888-8b11-bf5efef8a1f5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:16.134717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:16.135518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:16.135795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:16.136064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:16.146684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:31:16.154249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:31:16.155256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:31:16.156122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 597/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:31:16.161906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:16.261589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:16.264857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d6175-048d-4328-919e-14e4cac7dcdc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:16.313045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:16.313711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:16.313997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:16.314271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:16.315045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:16.315352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:16.316729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:16.325354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 592/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:31:16.331313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:16.400130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:16.439522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403fba4-93d2-4d30-996a-d5eda33f24dc None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:16.476669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:16.477529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:16.477809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:16.478082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] PATH_INFO: `/v3/users/f082de56c6ff4d1ea416914d5e074e2b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:16.479733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] RBAC: Authorizing `identity:get_user(user_id=f082de56c6ff4d1ea416914d5e074e2b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:16.481160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:16.482766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 598/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:31:16 2022] GET /identity/v3/users/f082de56c6ff4d1ea416914d5e074e2b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:16.489633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:16.599765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3d06-f08c-4654-b8e2-4d81d535fca7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:16.635165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:16.636003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:16.636282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:16.636554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] PATH_INFO: `/v3/projects/1bb3b040577d43c9a132663666358f60` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:16.637851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] RBAC: Authorizing `identity:get_project(project_id=1bb3b040577d43c9a132663666358f60)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:16.639315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06507e-29f9-4ec6-8924-b48d671ea410 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:16.641002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 593/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:31:16 2022] GET /identity/v3/projects/1bb3b040577d43c9a132663666358f60 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:16.651526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:16.756482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55242e18-d2da-4a53-872a-10ae3a063c5f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:16.790514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:16.800439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:16.801786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:16.802169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:16.802539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] PATH_INFO: `/v3/projects/1bb3b040577d43c9a132663666358f60/users/f082de56c6ff4d1ea416914d5e074e2b/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:16.805742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bb3b040577d43c9a132663666358f60, user_id=f082de56c6ff4d1ea416914d5e074e2b, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:16.808012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25556ef7-17f0-4d5a-a927-72a43f3a3fc1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:16.826500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 599/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:31:16 2022] PUT /identity/v3/projects/1bb3b040577d43c9a132663666358f60/users/f082de56c6ff4d1ea416914d5e074e2b/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:31:18.785526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf006e-6da3-4bc6-a9a7-a89b093c9f1c None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:18.786353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf006e-6da3-4bc6-a9a7-a89b093c9f1c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:18.786531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf006e-6da3-4bc6-a9a7-a89b093c9f1c None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:18.788710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 594/1193] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:31:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:31:18.794162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:18.794597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:18.794809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:18.814094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:31:18.815337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:31:18.889926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 600/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:31:18.923571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf006e-6da3-4bc6-a9a7-a89b093c9f1c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:18.966193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:19.042637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf006e-6da3-4bc6-a9a7-a89b093c9f1c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:19.078180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:19.078961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:19.079276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:19.079545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:19.090608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:31:19.098237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:31:19.099337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:31:19.100308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 595/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:31:19.106776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:19.217503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8a218-e7ad-4185-ac79-87c7a020f340 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:19.238427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:19.254210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:19.254879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:19.255200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:19.255474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:19.256232 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:19.256532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:19.258054 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:19.266542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 601/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:19.272686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:19.380766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:19.392665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8ad8-0980-4210-9225-e71926df2d1f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:19.428245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:19.429315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:19.429604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:19.429878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] PATH_INFO: `/v3/users/f082de56c6ff4d1ea416914d5e074e2b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:19.431832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] RBAC: Authorizing `identity:get_user(user_id=f082de56c6ff4d1ea416914d5e074e2b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:19.432675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:19.434396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 596/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 13 20:31:19 2022] GET /identity/v3/users/f082de56c6ff4d1ea416914d5e074e2b => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:19.440325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:19.539799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79f81-3325-4f6f-a44f-4a7742972732 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:19.574782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:19.575429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:19.575708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:19.575983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:19.625423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:19.644717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:19.646154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:19.749334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 602/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:31:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:31:19.758409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:19.868691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289df3-af4c-411c-84a1-d8b3ff1866e7 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:19.903785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:19.904637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:19.904919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:19.905205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] PATH_INFO: `/v3/projects/1bb3b040577d43c9a132663666358f60` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:19.906501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] RBAC: Authorizing `identity:get_project(project_id=1bb3b040577d43c9a132663666358f60)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:19.907968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a97ae-5c91-4496-a0b2-2e6492130ead None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:19.909664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 597/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 13 20:31:19 2022] GET /identity/v3/projects/1bb3b040577d43c9a132663666358f60 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:19.916793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:31:20.009785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:20.029566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c653d3-c2b3-4dda-a8e6-8fe2fe87b0b8 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:31:20.064590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:31:20.065216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:31:20.065491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:31:20.065759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:31:20.066566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=1bb3b040577d43c9a132663666358f60, user.id=f082de56c6ff4d1ea416914d5e074e2b) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:31:20.066860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:31:20.068300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f20c1-2e87-4a49-954f-ea00120b5e24 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:31:20.074179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 603/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:31:19 2022] GET /identity/v3/role_assignments?user.id=f082de56c6ff4d1ea416914d5e074e2b&scope.project.id=1bb3b040577d43c9a132663666358f60&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:31:29.898484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=87 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:31:30.071458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=27 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:15.101175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af38b-5cb6-4c9f-98f1-39b69b40e0eb None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:15.101809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af38b-5cb6-4c9f-98f1-39b69b40e0eb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:15.101809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af38b-5cb6-4c9f-98f1-39b69b40e0eb None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:15.103555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 598/1201] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:15.109445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:15.109995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:15.109995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:15.131874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:15.131874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:15.212171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 604/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:15.238334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af38b-5cb6-4c9f-98f1-39b69b40e0eb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:15.370340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af38b-5cb6-4c9f-98f1-39b69b40e0eb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:15.411072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:15.411894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:15.412169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:15.412457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:15.423605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:15.425140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:15.443311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:15.445080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:15.446103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:15.446103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:15.446103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:15.446103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:15.446103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 599/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:15.451289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:15.587159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561c0a-6412-458d-bdfd-21b1a7ca575c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:15.627424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:15.637226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:15.637894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:15.638172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:15.638444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:15.639553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:15.640084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:15.642345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368383a8-2f26-40ea-977c-e38f2b9c9981 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:15.663982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 605/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:15.669809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:15.732031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:15.797104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0f8f-5cc9-4174-be03-7db7926aac6d None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:15.841824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:15.844634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:15.844634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:15.844634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:15.844634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:15.845227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645b1f1-6cdf-48c1-82e8-eb8e541b791b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:15.876053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 600/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 13 20:32:15 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:32:18.068349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5364a5-0d9e-416e-b457-40aead6f6ecd None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.068349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5364a5-0d9e-416e-b457-40aead6f6ecd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.068349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5364a5-0d9e-416e-b457-40aead6f6ecd None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.070045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 606/1206] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:18.075765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.076203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.076397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.094174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:18.095451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:18.170772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:18.195159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5364a5-0d9e-416e-b457-40aead6f6ecd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:18.305715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5364a5-0d9e-416e-b457-40aead6f6ecd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:18.341242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:18.342012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.342312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.342610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.360269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:18.369209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:18.370392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:18.371429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 607/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:32:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:18.377373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:18.423445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:18.493062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519a20-ad8c-47e4-bc7c-4766ffd02bf5 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:18.533621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:18.534294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.534580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.534891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.535753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:18.536061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:18.537451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:18.550969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 602/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:18.556133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:18.610487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:18.673613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e967f3-bb9d-4cd0-b921-d774223a8b4a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:18.712510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:18.713328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.713606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.713875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.728126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:18.730154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:18.749604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:18.750610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:18.756590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:18.756590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:18.756590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:18.756590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:18.756590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 608/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:32:18.757100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:18.876326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:18.879200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d5e8d-f26e-41d3-bdfe-e1582a251874 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:18.917436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:18.918233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:18.918521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:18.918857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:18.919749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:18.920113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:18.921556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:18.934415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 603/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:18.940166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:19.066990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8b5f-a989-4c9d-9a18-a148302496a0 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:19.068568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:19.106387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:19.107232 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:19.107515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:19.107795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:19.115845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:19.117437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:19.134859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:19.136072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:19.137246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 609/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:19.138781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:19.248133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc607e-aa41-4fd7-9b57-b1074a69c156 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:19.282579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:19.284292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:19.284292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:19.284292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:19.284637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:19.284948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:19.286379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:19.305052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 604/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:19.310866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:19.427313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f80e-d5cd-4de9-ab78-36e5a779b048 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:19.464767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:19.465413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:19.465700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:19.465964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:19.499479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:19.548416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:19.550087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:19.656167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 610/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:32:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 20:32:19.662036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:19.684162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:19.779350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81e041-2cfa-47a5-a2ef-59f39be6485a None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:19.821919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:19.822774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:19.823100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:19.823408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:19.838268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:19.840063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:19.860276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:19.861418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:19.862420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:19.862420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:19.862420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:19.862420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:19.862420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 605/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:19.867390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:19.940895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:19.983563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467de9a-1ea3-43ce-a79b-1b83cabbd79f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:20.020091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:20.020751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:20.021072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:20.021351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:20.022101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:20.022509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:20.023981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:20.039396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 611/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:20.045451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:20.124135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:20.159304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327cbfa-c58f-4db7-a07f-815607de267f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:20.200303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:20.200759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:20.201019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:20.201310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:20.209491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:20.211430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:20.228493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:20.231126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:20.232003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 606/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:20.236222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:20.363025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4e355-86ba-4b46-b6d1-c14931c84273 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:20.390696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:20.402487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:20.403184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:20.403473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:20.403778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:20.404593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:20.404871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:20.406306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632024a-7f30-427b-9005-b2ac5e71e683 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:20.418936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 612/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:32:20.425305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:20.536193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b53c00-6b62-4486-9301-718a0d5f5bbc None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:20.569088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:20.576103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:20.579171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:20.579171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:20.579171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:20.579171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=85fda246a5de4acca67f975bd17f8139) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:20.579171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:20.580544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908fef-252d-41d1-9edd-f1a9a317a097 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:20.586605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 607/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:32:20 2022] GET /identity/v3/role_assignments?user.id=85fda246a5de4acca67f975bd17f8139&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:22.612972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b70b-c709-4e33-a10c-021fb4cc8507 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:22.613524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b70b-c709-4e33-a10c-021fb4cc8507 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:22.613524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b70b-c709-4e33-a10c-021fb4cc8507 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:22.614933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 613/1220] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:22.620513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:22.620942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:22.621074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:22.640395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:22.641774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:22.716821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 608/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:22.740850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7b70b-c709-4e33-a10c-021fb4cc8507 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:22.867821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7b70b-c709-4e33-a10c-021fb4cc8507 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:22.907416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:22.908376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:22.908700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:22.908929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:22.920021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:22.928347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:22.929692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:22.930692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 614/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:22.938588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.060612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6a4e8-a7e1-492f-835a-3eb76caac7c4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:23.094758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:23.111585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:23.112238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:23.112536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:23.112903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:23.113826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] RBAC: Adding query filter params (name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:23.114273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:23.116147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:23.127298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 609/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:32:23.136231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.188517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:23.257502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48e2f-188c-4072-a035-9bca54bf25e4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:23.297030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:23.297829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:23.298117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:23.298386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:23.309451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:23.310945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:23.329472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:23.330579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:23.336858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:23.336858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:23.336858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:23.336858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:23.336858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 615/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:23.337148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.452315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b61a64-88ac-44b9-bf63-5278b58fe537 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:23.487284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:23.487981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:23.488365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:23.488673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:23.489410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:23.489721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:23.491235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:23.504848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 610/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:23.511586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.617047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:23.624444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec987-ec2e-4dd7-bdad-f30fee126d18 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:23.659099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:23.659486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:23.659768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:23.660163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:23.669711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:23.671534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:23.689002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:23.689986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:23.690953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 616/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:23.696701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.751229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:23.810744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793b51-ad54-4b11-ba69-09c62b932be1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:23.845468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:23.846140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:23.846425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:23.846712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:23.847591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:23.847905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:23.850640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:23.868908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 611/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:32:23.874648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:23.984328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883f96-2a8b-4a78-9f66-b876a998fc4e None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:24.028244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:24.029242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:24.029587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:24.029976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:24.047905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:24.049758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:24.068620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:24.069886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:24.070769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:24.070769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:24.070769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:24.070769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:24.071035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 617/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:24.076963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:24.183773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabfcb8-fca2-4fc4-920e-df77d58dc884 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:24.186202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:24.220877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:24.221544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:24.221835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:24.222115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:24.222837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:24.223178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:24.224557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:24.238645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 612/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:24.244919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:24.256153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:24.358407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc66db-08ef-464d-837a-89ceef92bc4c None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:24.400974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:24.401789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:24.402068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:24.402339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:24.410757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:24.412673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:24.428332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:24.429344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:24.430443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 618/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:24.436418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:24.542737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b185746-2180-42ef-897e-da97544c19bb None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:24.580945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:24.581623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:24.581909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:24.582186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:24.583009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:24.583330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:24.584830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e5704-737a-4d56-8752-4fc429ca610e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:24.599043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 613/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:24.605503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:24.681203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:24.725295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2577f-5afc-4ffc-8985-3386398184c0 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:24.767630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:24.768671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:24.768975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:24.769300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/85fda246a5de4acca67f975bd17f8139/roles/f9074f22bbb84e26a67d4f8913a65052` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:24.787512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=85fda246a5de4acca67f975bd17f8139, role_id=f9074f22bbb84e26a67d4f8913a65052)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:24.789566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36b54f-d025-4b17-b075-00a4dcf1a840 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:24.803730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 619/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:32:24 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/85fda246a5de4acca67f975bd17f8139/roles/f9074f22bbb84e26a67d4f8913a65052 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:32:26.822909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a5a9-ad67-4a63-ba64-e98612cbf5b9 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:26.823644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a5a9-ad67-4a63-ba64-e98612cbf5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:26.823644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a5a9-ad67-4a63-ba64-e98612cbf5b9 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:26.824884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 614/1233] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:26.830095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:26.830565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:26.830683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:26.847837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:26.849053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:26.916646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 20:32:26.940561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8a5a9-ad67-4a63-ba64-e98612cbf5b9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:26.968736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:27.053772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8a5a9-ad67-4a63-ba64-e98612cbf5b9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.091459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.092256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.092632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.092945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.105158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:27.113618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:27.114845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:27.115729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 615/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 13 20:32:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:27.122028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:27.172980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:27.231586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7964-2862-46ef-9a11-6b8caa2e554c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.267274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.267912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.268192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.268458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.269197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:27.269498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:27.270849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:27.279020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 621/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 13 20:32:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:27.284902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:27.373695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:27.393858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145697b-2239-4832-9579-a7bf9b955e29 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.429823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.430543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.430822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.431121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.442929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:27.444720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:27.463067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:27.464656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:27.465898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:27.465898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:27.465898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:27.465898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:27.465898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 616/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:27.470833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:27.577408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d719-f6ca-414f-bb92-14198391b1f9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.586669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:27.617099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.617771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.618055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.618331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.619082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:27.619386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:27.620777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:27.633134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 622/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:32:27.638982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:27.746909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5fd9-c455-4f14-aa0f-20459348df1b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.786540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.787375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.787659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.787936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.791842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:27.797661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:27.799409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:27.814192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:27.815446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:27.816429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 617/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:27.822101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:27.935955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373f172-ded7-4819-aee3-41307331ebfe None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:27.973968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:27.974660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:27.974964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:27.975249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:27.976239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:27.976564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:27.978003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:27.997523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 623/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:28.003474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:28.125000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dba7a-7b87-4ee5-a7e3-d63a68e4f980 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:28.162015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:28.162666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:28.163020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:28.163429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:28.230235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:28.237077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:28.238536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:28.346547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 618/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:32:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:32:28.352865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:28.392287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:28.483958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ad83-4b59-4011-8e1b-5dbcfbc2a801 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:28.519037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:28.519862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:28.520186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:28.520474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:28.531361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:28.532989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:28.552009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:28.553213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:28.554245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:28.554245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:28.554245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:28.554245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:28.554245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 624/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:28.560955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:28.669242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:28.675462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037913a-130e-4297-8a68-78c99863d896 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:28.713906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:28.714813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:28.715421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:28.715838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:28.716772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:28.717035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:28.718451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:28.733241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 619/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:28.738938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:28.823064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:28.848897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0def02-d59e-4e5c-b4fd-97c32ab5a81a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:28.895264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:28.896203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:28.896525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:28.896930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:28.904235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:28.905676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:28.922502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:28.923779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:28.924770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 625/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:28.930111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:29.047056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13597d-76ea-483f-af88-905eec6658db None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:29.086800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:29.087690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:29.088066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:29.088439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:29.089290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:29.089586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:29.091096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef39aa-fe38-4e8f-93b4-dc958eb034ec None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:29.103978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 620/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:29.110429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:29.217892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f1f4c-3513-4010-af75-226c7dfc601f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:29.259555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:29.260270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:29.260565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:29.260901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:29.261906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] RBAC: Adding query filter params (role.id=f9074f22bbb84e26a67d4f8913a65052, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=85fda246a5de4acca67f975bd17f8139) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:29.262253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:29.264016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542248e1-4a31-4de1-8e6f-9b9fb24e2742 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:29.271493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 626/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:32:29 2022] GET /identity/v3/role_assignments?user.id=85fda246a5de4acca67f975bd17f8139&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=f9074f22bbb84e26a67d4f8913a65052 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:31.468009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ff63-e3ab-43af-acec-c3f8fe5ccb51 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:31.468602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ff63-e3ab-43af-acec-c3f8fe5ccb51 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:31.468693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3ff63-e3ab-43af-acec-c3f8fe5ccb51 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:31.470342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 621/1247] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:31.476420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:31.476877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:31.477060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:31.483737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:31.497671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:31.499123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:31.576853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 627/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:31.603217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3ff63-e3ab-43af-acec-c3f8fe5ccb51 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:31.624877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:31.723324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3ff63-e3ab-43af-acec-c3f8fe5ccb51 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:31.762365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:31.763321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:31.763650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:31.763983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:31.776075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:31.784238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:31.785355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:31.786492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 622/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:31.792112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:31.901714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d35d91-570e-4706-bef0-66ba522a288f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:31.932387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:31.938000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:31.938754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:31.939127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:31.939495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:31.940245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:31.940547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:31.942105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:31.951594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 628/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:31.958826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:32.045286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:32.070039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8722a-f9be-4caa-82ef-975104217220 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:32.107791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:32.108678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:32.108962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:32.109239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:32.121874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:32.123426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:32.141260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:32.142549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:32.143622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:32.143622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:32.143622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:32.143622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:32.143622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 623/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:32.148489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:32.256907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4f70e-4b05-4ca2-9d26-6b20fb3b6aea None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:32.292704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:32.293321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:32.293689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:32.293951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:32.294678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:32.295013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:32.296561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:32.309839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 629/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:32.316909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:32.431597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707dc1-36d6-4829-8af4-dbe3d4a3c65c None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:32.460200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:32.468829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:32.470391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:32.470844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:32.471188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:32.479426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:32.481561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:32.497134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:32.498362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:32.499415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 624/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 20:32:32.504545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:32.567283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:32.616285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04d31-852c-4a52-8878-f9dbe5a6067f None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:32.653420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:32.654202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:32.654491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:32.654781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:32.655747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:32.656057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:32.657569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:32.682369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 630/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:32.684104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:32.790676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b07a2-38d9-4619-a663-f4e42ae5a990 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:32.828838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:32.829400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:32.829982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:32.830332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:32.894291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:32.911679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:32.913274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.020644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 625/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:32:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 20:32:33.026958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:33.141301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d6f47-84b5-4851-a63e-31326cbe72fb None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:33.158183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:33.183037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:33.183842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:33.184124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:33.184396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:33.195255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:33.196753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:33.214699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:33.215916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:33.217076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:33.217076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:33.217076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:33.217076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:33.217076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 631/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:33.221831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:33.329458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:33.342003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb0e7b-4fc7-429c-a481-a0b2024141d1 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:33.386233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:33.386742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:33.387050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:33.387335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:33.388165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:33.388392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:33.389774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.403163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 626/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:33.409212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:33.518445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b78d37-5159-4a6c-98e0-6b20b88a664a None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:33.554547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:33.555480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:33.555789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:33.556088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:33.564885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:33.566537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:33.580723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:33.581936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:33.583082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 632/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:33.588222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:33.696938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee298f69-de39-476f-9057-c8617e25bb55 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:33.736478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:33.737146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:33.737466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:33.737746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:33.738529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:33.738844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:33.740326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed09e0-0938-46ac-b354-827b67d343d7 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.752704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 627/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:33.759052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:33.788921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:33.870047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff24f-6f86-4a7b-99c8-5b46bd547826 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:33.904006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:33.904682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:33.904948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:33.905204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:33.906032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=85fda246a5de4acca67f975bd17f8139) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:33.906395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:33.907796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e468e-9186-45cd-a26f-836a814fa61d None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:33.914239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 633/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:32:33 2022] GET /identity/v3/role_assignments?user.id=85fda246a5de4acca67f975bd17f8139&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:32:36.013787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190025-a165-4dda-9472-b81eaf2e8315 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.014333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190025-a165-4dda-9472-b81eaf2e8315 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.014333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31190025-a165-4dda-9472-b81eaf2e8315 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.015775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 628/1261] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:36.022136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428626b8-f2cc-4788-b716-366a92416196 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.023123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428626b8-f2cc-4788-b716-366a92416196 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.023749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428626b8-f2cc-4788-b716-366a92416196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.047257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-428626b8-f2cc-4788-b716-366a92416196 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:36.048457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-428626b8-f2cc-4788-b716-366a92416196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:36.121413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 634/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:36.144339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31190025-a165-4dda-9472-b81eaf2e8315 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:36.163290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:36.285058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31190025-a165-4dda-9472-b81eaf2e8315 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:36.323722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:36.324928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.325375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.325809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.343678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:36.353503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:36.354441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:36.355740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 629/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:36.363570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428626b8-f2cc-4788-b716-366a92416196 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:36.386701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:36.485011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428626b8-f2cc-4788-b716-366a92416196 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:36.526750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:36.527437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.527711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.527978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.528726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:36.529032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:36.530385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:36.538596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 635/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:36.545193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:36.618737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:36.653520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916da6-a23c-4a4b-9f86-d7825bb8da9f None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:36.688383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:36.689176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.689467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.689737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.700772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:36.702218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:36.720325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:36.721334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:36.722239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:36.722239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:36.722239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:36.722239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:36.722239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 630/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:36.731509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:36.824051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:36.848683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5fa98-11b5-417c-8fc3-f644cbf5f660 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:36.884806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:36.885461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:36.885746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:36.886019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:36.886735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:36.887085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:36.888461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:36.900988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 636/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:36.907647 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.016462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed8f2-2245-46e4-b540-20192201e392 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.036311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:37.055101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.055909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.056191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.056469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.064889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.066330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:37.081210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:37.082343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:37.083600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 631/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:37.089864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.196162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a610bc-f7b0-4498-a0de-e33ef7cabdb4 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.231161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.231807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.232082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.232353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.233176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:37.233473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.234904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.243770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:37.257520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 637/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:37.266460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.378214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4b9e7-9f8c-4622-86ef-ea47c232f9a6 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.423331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.424130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.424414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.424691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.436916 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.438379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:37.456043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:37.457043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:37.458029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:37.458029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:37.458029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:37.458029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:37.458029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 632/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:37.463970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.576337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc50f-8d3a-4c88-8709-8a27be9789ae None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.611462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.612114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.612392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.612660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.613374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:37.613675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.615060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.626357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 638/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:37.633292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.676221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:37.745601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b8a4-540d-4d35-8a70-d4dbe82a3fa3 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.782030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.782825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.783146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.783418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.790715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.792207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:37.806270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:37.807294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:37.808270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 633/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:37.814233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:37.877016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:37.926335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991532f8-7f72-4b7c-8f3f-3e06be1b2ff7 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:37.960700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:37.961346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:37.961628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:37.961904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:37.962669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:37.962997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:37.964424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6fb9-03e1-48fa-8c72-75cce70f3889 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:37.976453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 639/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:37.982951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:38.076325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:38.086457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac927a7-ea57-4e8f-9f08-09d74a6e9d58 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:38.121788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:38.122656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:38.122960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:38.123243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] PATH_INFO: `/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/85fda246a5de4acca67f975bd17f8139/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:38.125230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] RBAC: Authorizing `identity:create_grant(project_id=82d6f6afc9fd41369ce79f8fea8540e3, user_id=85fda246a5de4acca67f975bd17f8139, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:38.126659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc7950-c1d3-4857-bd2b-1a09ce12df3c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:38.146826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 634/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 13 20:32:37 2022] PUT /identity/v3/projects/82d6f6afc9fd41369ce79f8fea8540e3/users/85fda246a5de4acca67f975bd17f8139/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:32:40.138168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50eadb-bdc9-4bb7-b3ad-56074a838e12 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.139055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50eadb-bdc9-4bb7-b3ad-56074a838e12 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.139055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50eadb-bdc9-4bb7-b3ad-56074a838e12 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.141312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 640/1274] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:40.147611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.148421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.148710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.166104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:40.167343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:40.242737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 635/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:40.276519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50eadb-bdc9-4bb7-b3ad-56074a838e12 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:40.405759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50eadb-bdc9-4bb7-b3ad-56074a838e12 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:40.424156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:40.441826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:40.442621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.442907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.443276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.454171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 20:32:40.462194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:40.463306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:40.464399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 641/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 13 20:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:40.471195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:40.557033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:40.579700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf9878-cc3b-458d-a3ee-8c00792707fe None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:40.618484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:40.619168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.619449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.619726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.620477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:40.620789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:40.622154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:40.631147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 636/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 13 20:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:40.639563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:40.754204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164b2a9-1d86-4fbc-b24f-f215bc654135 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:40.796582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:40.797363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.797640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.797909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.809161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:40.810612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:40.829245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:40.830164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:40.831263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:40.831263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:40.831263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:40.831263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:40.831263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 642/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:40.837019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:40.953847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e2e0-bb62-4c35-abd9-15395a77d11e None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:40.990821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:40.991989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:40.992280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:40.992542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:40.993267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:40.993574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:40.994954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:41.008040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 637/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:41.017352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:41.062682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:41.137302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed937c-36ad-4576-90b2-86ac9cf03484 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:41.173578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:41.174758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:41.175228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:41.175655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:41.184372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:41.185824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 20:32:41.200792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:41.201883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:41.203133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 643/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:41.208531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:41.213311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:41.322473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ead13a-3586-44d6-acb2-1c1749016bed None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:41.362134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:41.362949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:41.363292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:41.363629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:41.364597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:41.364973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:41.366754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:41.386342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 638/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 13 20:32:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:41.392883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:41.494248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:41.504789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4849c4-9d83-489b-a75c-a8ca13f07da1 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:41.541755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:41.542397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:41.542682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:41.542950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:41.615341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:41.617040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:41.709724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:41.724497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 644/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 13 20:32:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 20:32:41.734125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:41.801783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:41.844553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ed4e8-b423-402c-b58a-b5eb1bd92775 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:41.882865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:41.883718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:41.884002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:41.884281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:41.895065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:41.896533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 20:32:41.914354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:41.915457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:41.916553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 20:32:41.916553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 20:32:41.916553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 20:32:41.916553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:41.916553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 639/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:41.921266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:42.024024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02df9-66ec-43d8-a153-3e1aacc0eca5 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:42.059656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:42.060243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:42.060518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:42.060786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:42.061504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:42.061801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:42.063195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:42.075702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 645/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 13 20:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:42.084538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:42.196262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82720c0-ff1c-42cd-9ab8-191d81e8af50 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:42.210474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:42.233198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331050-def4-4734-827c-317c768e07b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:42.233972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331050-def4-4734-827c-317c768e07b0 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:42.234250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331050-def4-4734-827c-317c768e07b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:42.234523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331050-def4-4734-827c-317c768e07b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:42.241341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73331050-def4-4734-827c-317c768e07b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:42.242814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73331050-def4-4734-827c-317c768e07b0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application [None req-73331050-def4-4734-827c-317c768e07b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 20:32:42.257803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:42.258783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: ERROR keystone.server.flask.application Jul 13 20:32:42.259724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 640/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 13 20:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:42.265036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:42.323468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:42.379134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74800cb6-1f84-4d99-85b6-6dff56a81e01 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:42.416202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:42.416853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:42.417101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:42.417405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:42.418182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:42.418482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:42.419930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d3255-7f4c-48af-94b5-657e9d240d79 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:42.435991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 646/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 13 20:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:42.442212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331050-def4-4734-827c-317c768e07b0 None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:42.543944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331050-def4-4734-827c-317c768e07b0 None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:42.577973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:42.578536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:42.578816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:42.579099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:42.579919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] RBAC: Adding query filter params (role.id=8674ca022dbe4b239eb4b83af2de25b7, scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3, user.id=85fda246a5de4acca67f975bd17f8139) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:42.580221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:42.581644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf627c2-733e-421b-baf6-d2c732f7078c None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:42.587577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 641/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 13 20:32:42 2022] GET /identity/v3/role_assignments?user.id=85fda246a5de4acca67f975bd17f8139&scope.project.id=82d6f6afc9fd41369ce79f8fea8540e3&role.id=8674ca022dbe4b239eb4b83af2de25b7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:44.606334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53b90-b943-408b-873b-9c6a4e1e7c6d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:44.606957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53b90-b943-408b-873b-9c6a4e1e7c6d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:44.606957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53b90-b943-408b-873b-9c6a4e1e7c6d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:44.608313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 647/1288] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:44.614703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:44.615445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:44.615655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:44.638579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:44.639805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:44.679389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:44.720043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 642/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:44.743307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d53b90-b943-408b-873b-9c6a4e1e7c6d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:44.854752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d53b90-b943-408b-873b-9c6a4e1e7c6d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:44.867679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:44.896580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:44.897404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:44.897730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:44.898005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:44.898657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:44.900076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:44.911814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:44.913046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:44.914172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 648/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:32:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:44.920966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:45.027754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f89f0-c8b5-4d86-8d01-76355cc0d072 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:45.063341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:45.063985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:45.064264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:45.064536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:45.065236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:45.065542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:45.066951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c861d-02b0-4b59-a3d6-2df7a757e9e4 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:45.071996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 643/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 13 20:32:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:45.078071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:45.192005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946d8cd-9ffe-47a5-bbde-a2d0b975daaa None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:45.228007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:45.228652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:45.228933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:45.229204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] PATH_INFO: `/v3/services` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:45.229907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:45.230530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:45.231941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3e691-79b3-437b-a602-b2061e41d856 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:45.236537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 649/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 13 20:32:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:47.221911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d10e-6d8c-4392-a369-6833764d6bfc None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:47.222504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d10e-6d8c-4392-a369-6833764d6bfc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:47.222504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d10e-6d8c-4392-a369-6833764d6bfc None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:47.223881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 644/1293] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:47.230473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49368d-8df4-4a1d-84bf-b66db04d8256 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:47.231193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49368d-8df4-4a1d-84bf-b66db04d8256 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:47.231388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49368d-8df4-4a1d-84bf-b66db04d8256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:47.252993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9f49368d-8df4-4a1d-84bf-b66db04d8256 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:47.254197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9f49368d-8df4-4a1d-84bf-b66db04d8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:47.287445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:47.327663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 650/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:47.361019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d10e-6d8c-4392-a369-6833764d6bfc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:47.406670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:47.482133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d10e-6d8c-4392-a369-6833764d6bfc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:47.518234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:47.518888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:47.519212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:47.519487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:47.520217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:47.521608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a558a-b075-46b0-99a5-f40e071498c0 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:47.544304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 645/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 13 20:32:47 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:32:49.523973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad096-890d-4428-9007-b585a99db71d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:49.524863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad096-890d-4428-9007-b585a99db71d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:49.524863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad096-890d-4428-9007-b585a99db71d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:49.527091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 651/1296] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:49.533225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:49.533668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:49.533855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:49.554799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:49.556027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:49.640805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 646/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:49.670088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ad096-890d-4428-9007-b585a99db71d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:49.776547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ad096-890d-4428-9007-b585a99db71d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:49.811751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:49.812531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:49.812806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:49.813081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:49.813738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:49.815141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:49.827444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:49.828550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:49.829411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 652/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:32:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:49.836751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:49.857717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:49.940284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5946-5015-4e64-be7b-f096f422f57c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:49.975219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:49.976050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:49.976333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:49.976606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:49.977308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:49.977611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:49.978965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:49.984542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 647/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 13 20:32:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:49.990693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:50.028733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:50.098294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733599-64f6-4a1c-9678-249095c16b58 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:50.133473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:50.134102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:50.134377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:50.134650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:50.135458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] RBAC: Adding query filter params (interface=public, service_id=baffc1455461432f8af82a697d0f6c1a, region_id=RegionOne) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:50.135763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:50.137117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e569-87df-4f42-be09-663646be41b2 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:50.142208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 653/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 13 20:32:49 2022] GET /identity/v3/endpoints?service_id=baffc1455461432f8af82a697d0f6c1a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:50.148078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:50.244813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:50.265236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f895ba-89b2-404e-addf-421d8284322b None admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:50.300229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:50.300816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:50.301100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:50.301379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:50.302057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:50.303463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cebb7-2825-4cdb-a5fb-d548e9991334 None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:50.310359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 648/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 13 20:32:50 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:32:52.309812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2393-1dd1-4408-96b1-e2d2e5885926 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:52.310390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2393-1dd1-4408-96b1-e2d2e5885926 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:52.310390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2393-1dd1-4408-96b1-e2d2e5885926 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:52.311786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 654/1302] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:32:52.317947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:52.318665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:52.318799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:52.341818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:32:52.342997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:32:52.418496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 649/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:32:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 20:32:52.441085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2393-1dd1-4408-96b1-e2d2e5885926 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:52.540806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:52.548810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2393-1dd1-4408-96b1-e2d2e5885926 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:52.583153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:52.583864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:52.584136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:52.584408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:52.585068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:52.586435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 20:32:52.598274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 20:32:52.599376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application with Lock( Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self._enter() Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application return self.creator() Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application created_value = creator( Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: ERROR keystone.server.flask.application Jul 13 20:32:52.600317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 655/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 13 20:32:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 20:32:52.606691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:52.695675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:32:52.721595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10094b-2f28-4d5e-9d3e-e9833563084a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:52.757042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:52.757707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:52.757994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:52.758268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] PATH_INFO: `/v3/services` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:52.759012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:32:52.759319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:52.760769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d86a6-6cdc-4f50-88bb-e1d9f96fac2b None admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:52.766062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 650/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 13 20:32:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:32:52.772235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:32:52.877699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81208-d15e-4702-8160-796d43fe9bd9 None admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:32:52.914223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:32:52.914862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:32:52.915174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:32:52.915457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:32:52.916194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:32:52.917586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eefe5-1219-4385-b183-0360bb78eafe None admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:32:52.940548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 656/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 13 20:32:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:33:02.762943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=30 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:02.935777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:56.081457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727760fc-eb0c-4bc4-8163-ff72aaa28826 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:56.082019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727760fc-eb0c-4bc4-8163-ff72aaa28826 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:56.082019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727760fc-eb0c-4bc4-8163-ff72aaa28826 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:56.088934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7428f-b34f-4f2e-9c4b-00bf188fbfcd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:56.089416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7428f-b34f-4f2e-9c4b-00bf188fbfcd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:56.089504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7428f-b34f-4f2e-9c4b-00bf188fbfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:56.091671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 651/1307] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:33:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:33:56.245893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9ae7428f-b34f-4f2e-9c4b-00bf188fbfcd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:33:56.248814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9ae7428f-b34f-4f2e-9c4b-00bf188fbfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:56.424944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 657/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:33:56.474762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:56.475096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:56.475373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:56.477241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 652/1309] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jul 13 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:33:56.483581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1167c4-b2b9-42db-9f6c-cef447f75983 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:56.483955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1167c4-b2b9-42db-9f6c-cef447f75983 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:56.484298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1167c4-b2b9-42db-9f6c-cef447f75983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:56.561066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5e1167c4-b2b9-42db-9f6c-cef447f75983 None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:33:56.562300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5e1167c4-b2b9-42db-9f6c-cef447f75983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:56.584677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:56.644258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 658/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jul 13 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:33:56.652861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:33:56.654614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:56.766011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085625af-0e30-442c-a341-ed8bd63ba2f8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:33:56.842032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:33:56.842693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:56.843010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:56.843289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:56.844915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:56.901868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:56.958326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:33:56.959820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e481e9-2c33-4eca-bbc2-e0cefbcdecd6 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:33:56.982729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 653/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:33:59.264131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f80ac-168c-440f-a080-6a31157e8817 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:59.264720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f80ac-168c-440f-a080-6a31157e8817 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:59.264720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f80ac-168c-440f-a080-6a31157e8817 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:59.266061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 659/1312] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:33:59.271656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754213b5-3004-44a5-a923-73b2ae5f4f8b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:59.272103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754213b5-3004-44a5-a923-73b2ae5f4f8b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:59.272209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754213b5-3004-44a5-a923-73b2ae5f4f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:59.357376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-754213b5-3004-44a5-a923-73b2ae5f4f8b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:33:59.358644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-754213b5-3004-44a5-a923-73b2ae5f4f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:59.462425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 654/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:33:59.511571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:59.511864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:59.512138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:59.513538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 660/1314] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jul 13 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:33:59.519458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364cf5-8ea8-495f-97c3-643a699d4741 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:59.519652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364cf5-8ea8-495f-97c3-643a699d4741 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:59.519927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364cf5-8ea8-495f-97c3-643a699d4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:59.530198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:59.596591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9a364cf5-8ea8-495f-97c3-643a699d4741 None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:33:59.597806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9a364cf5-8ea8-495f-97c3-643a699d4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:59.675414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 655/1315] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jul 13 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:33:59.684395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:33:59.686295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:59.790003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f9e0d-b625-4568-bcfd-bcf5242c87ce None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:33:59.864745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:33:59.867556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:33:59.868837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:33:59.869262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:33:59.869534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:33:59.873022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:33:59.995049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:33:59.996489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371eaa0a-0c1b-465d-bc18-46267fe0c5e8 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:00.017208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 661/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:02.550887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:02.551447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:02.551447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:02.552880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 656/1317] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:02.558303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe9f5-d4c8-4717-82a6-716671c5a485 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:02.558720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe9f5-d4c8-4717-82a6-716671c5a485 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:02.558841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe9f5-d4c8-4717-82a6-716671c5a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:02.631454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b1afe9f5-d4c8-4717-82a6-716671c5a485 None None] MFA Rules not processed for user `8e28e32fa9374a028b56752cdb237ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:02.632691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b1afe9f5-d4c8-4717-82a6-716671c5a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:02.694717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:02.761920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 662/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:34:02.819469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:02.821034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:02.944125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bf664-91f9-44b5-a668-90f7c465acbc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:02.947112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:03.029584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:03.030236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:03.030523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:03.030776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:03.032612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:03.168755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:03.170222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c3cf1-d3a3-4a24-b5fe-f5cf99277605 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:03.192420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 657/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:05.872725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:05.873308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:05.873308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:05.875687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 663/1320] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:05.882728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b66b-5d39-4a9c-b540-eebc1d945640 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:05.883506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b66b-5d39-4a9c-b540-eebc1d945640 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:05.883610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14b66b-5d39-4a9c-b540-eebc1d945640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:05.930188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:05.967703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ac14b66b-5d39-4a9c-b540-eebc1d945640 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:05.968946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ac14b66b-5d39-4a9c-b540-eebc1d945640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:06.080761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 658/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:06.119879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:06.121414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:06.243507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eb7c6-6b47-4eb3-a208-42cd1d464a46 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:06.322459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:06.323132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:06.323412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:06.323690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:06.325313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:06.333499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:06.453801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:06.456063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfbc55-a99c-4d8d-93ae-eca3f8a4420f service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:06.477504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 664/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:34:09.173122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:09.173684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:09.173684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:09.175132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 659/1323] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:09.180482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fdd49-7484-49bd-be84-9e17644cc85b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:09.180924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fdd49-7484-49bd-be84-9e17644cc85b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:09.181017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fdd49-7484-49bd-be84-9e17644cc85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:09.251916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-710fdd49-7484-49bd-be84-9e17644cc85b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:09.253143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-710fdd49-7484-49bd-be84-9e17644cc85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:09.319668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:09.367437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 665/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:09.405581 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:09.408071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:09.523773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810be38-af03-4431-b3aa-f0e3fcbcc539 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:09.536330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:09.598458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:09.599156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:09.599440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:09.599716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:09.601966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:09.718723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:09.720366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd92dbb-1a88-4d3a-8b60-e55b77627122 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:09.740631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 660/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:11.791946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:11.792480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:11.792480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:11.793764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 666/1326] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:11.799076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1c49e-7e68-4972-bbfc-80a39b415275 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:11.799511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1c49e-7e68-4972-bbfc-80a39b415275 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:11.799598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1c49e-7e68-4972-bbfc-80a39b415275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:11.847233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:11.865954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a5e1c49e-7e68-4972-bbfc-80a39b415275 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:11.867198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a5e1c49e-7e68-4972-bbfc-80a39b415275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:11.962848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 661/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:11.998189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:11.999754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:12.105209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720cbcd-8ab9-451c-96de-2f7bde3249a8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:12.187454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:12.188113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:12.188435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:12.188709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:12.190372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:12.207691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:12.303975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:12.305460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de732b-afb0-46d7-84fc-0a1eb8b72948 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:12.324964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 667/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:14.437800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:14.439067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:14.439067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:14.439867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 662/1329] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:14.446077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c70c14-17b5-4d03-9cd4-1d5b9d71fb5f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:14.446617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c70c14-17b5-4d03-9cd4-1d5b9d71fb5f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:14.446617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c70c14-17b5-4d03-9cd4-1d5b9d71fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:14.525653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-87c70c14-17b5-4d03-9cd4-1d5b9d71fb5f None None] MFA Rules not processed for user `8e28e32fa9374a028b56752cdb237ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:14.526908 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-87c70c14-17b5-4d03-9cd4-1d5b9d71fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:14.600610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:14.633411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 668/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:14.670173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:14.671764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:14.781029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa09b1-f462-4231-860c-239ba563593b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:14.801683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:14.858437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:14.859118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:14.859405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:14.859679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:14.861534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:14.991554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:14.993022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd51042-8672-44b4-8431-4d142477b0a7 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:15.013445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 663/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:34:17.284636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:17.285234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:17.285234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:17.287094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 669/1332] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:17.294155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6cc5-581f-4b37-808f-86f074e5019b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:17.294614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6cc5-581f-4b37-808f-86f074e5019b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:17.294707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc6cc5-581f-4b37-808f-86f074e5019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:17.368372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:17.371568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-64bc6cc5-581f-4b37-808f-86f074e5019b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:17.373273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-64bc6cc5-581f-4b37-808f-86f074e5019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:17.479679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 664/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:17.517300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:17.519531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:17.637213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2284e3-595b-4987-a24d-27b3d8bf7690 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:17.714667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:17.715372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:17.715682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:17.715954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:17.717713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:17.748046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:17.836048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:17.837502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96289-2117-46bc-b38d-434cfe68d891 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:17.856557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 670/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:19.911236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:19.911784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:19.911784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:19.913074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 665/1335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:19.918959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d6a8-87c8-4e03-8213-37e68d812e0e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:19.919388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d6a8-87c8-4e03-8213-37e68d812e0e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:19.919577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d6a8-87c8-4e03-8213-37e68d812e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:19.985586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fed8d6a8-87c8-4e03-8213-37e68d812e0e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:19.986793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fed8d6a8-87c8-4e03-8213-37e68d812e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:20.068603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:20.094587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 671/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:20.136925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:20.139170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:20.275538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebc902-126a-4bf6-9e18-ac54673a0f99 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:20.313796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:20.370265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:20.370970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:20.371253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:20.371524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:20.373162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:20.487452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:20.488917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048b63-e398-4c05-a4b9-085ed7c76922 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:20.508291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 666/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:23.175935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:23.176504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:23.176504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:23.178772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 672/1338] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:23.187697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd590-2d06-4689-9e9f-7ee71fca2e88 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:23.188459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd590-2d06-4689-9e9f-7ee71fca2e88 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:23.188642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd590-2d06-4689-9e9f-7ee71fca2e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:23.260092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1cefd590-2d06-4689-9e9f-7ee71fca2e88 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:23.261324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1cefd590-2d06-4689-9e9f-7ee71fca2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:23.270257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:23.366746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 667/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:23.403973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:23.405530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:23.518366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed62422-9da8-4a6d-b3c0-2510ceaf1765 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:23.608110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:23.608734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:23.609040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:23.609317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:23.611017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:23.647763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:23.724040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:23.725819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a1ce5-a54c-4e20-9b2a-5eb85382d3d4 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:23.744588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 673/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:27.930158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:27.930720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:27.930720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:27.932069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 668/1341] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:27.937455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602b8d-d57d-4f4e-99fa-29938a0991e7 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:27.937871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602b8d-d57d-4f4e-99fa-29938a0991e7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:27.938593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602b8d-d57d-4f4e-99fa-29938a0991e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:28.009015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-40602b8d-d57d-4f4e-99fa-29938a0991e7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:28.010251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-40602b8d-d57d-4f4e-99fa-29938a0991e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:28.107273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:28.122283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 674/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:28.161050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:28.162681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:28.271296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8f09-b96a-42a9-a0f0-6b0751341628 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:28.309508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:28.347190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:28.347838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:28.348121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:28.348385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:28.350320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:28.464056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:28.465511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d179e0-7e82-4f23-9c7b-34802227d5e0 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:28.485707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 669/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:31.122041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:31.122634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:31.122634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:31.124011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 675/1344] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:31.130541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6458-e416-4a0d-a20c-5768af35be2c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:31.131133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6458-e416-4a0d-a20c-5768af35be2c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:31.131133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a6458-e416-4a0d-a20c-5768af35be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:31.203281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-592a6458-e416-4a0d-a20c-5768af35be2c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:31.204582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-592a6458-e416-4a0d-a20c-5768af35be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:31.223050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:31.308220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 670/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:31.345511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:31.347187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:31.457415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ef30-e1b1-44c1-9d2d-9dd48cd26373 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:31.533267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:31.533906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:31.534184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:31.534454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:31.536126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:31.579799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:31.649588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:31.651062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733280a-a407-4d0a-a480-9849ace487c8 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:31.673521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 676/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:36.015058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:36.015591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:36.015591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:36.016936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 671/1347] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:36.022700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf81f-1ce0-4b28-a2f3-59378b8fc511 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:36.023246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf81f-1ce0-4b28-a2f3-59378b8fc511 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:36.023246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf81f-1ce0-4b28-a2f3-59378b8fc511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:36.095220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b0caf81f-1ce0-4b28-a2f3-59378b8fc511 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:36.096456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b0caf81f-1ce0-4b28-a2f3-59378b8fc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:36.197695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:36.203108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 677/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:36.242144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:36.243633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:36.357856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9718-9210-42b3-83e0-4b0741950eeb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:36.409790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:36.436456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:36.437112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:36.437390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:36.437724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:36.439374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:36.549628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:36.551023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c4964-25d4-44d6-9a5c-815130cbd217 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:36.571833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 672/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:41.408004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc917a4-80f6-4b59-96ea-79621a4f467a None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:41.408481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc917a4-80f6-4b59-96ea-79621a4f467a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:41.408577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc917a4-80f6-4b59-96ea-79621a4f467a None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:41.410429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 678/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:41.415294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c744-c7f9-4d98-a583-0709ac3466c2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:41.415748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c744-c7f9-4d98-a583-0709ac3466c2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:41.415882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c744-c7f9-4d98-a583-0709ac3466c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:41.534815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-86b0c744-c7f9-4d98-a583-0709ac3466c2 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:41.534815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-86b0c744-c7f9-4d98-a583-0709ac3466c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:41.576961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:41.684755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 673/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:34:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:45.884708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703877-c9b0-47e9-83af-8834595a8bdd None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:45.885580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703877-c9b0-47e9-83af-8834595a8bdd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:45.886069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703877-c9b0-47e9-83af-8834595a8bdd None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:45.887631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 679/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:34:45.892601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d3b9-d230-4e57-b0fe-04494c0da770 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:45.893098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d3b9-d230-4e57-b0fe-04494c0da770 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:45.893468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d3b9-d230-4e57-b0fe-04494c0da770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:45.971039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8364d3b9-d230-4e57-b0fe-04494c0da770 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:45.973968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8364d3b9-d230-4e57-b0fe-04494c0da770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:46.051360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:46.096764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 674/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:34:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:47.269430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9862-959f-49b1-bc53-d15ec23e70ca None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:47.270016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9862-959f-49b1-bc53-d15ec23e70ca None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:47.270110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a9862-959f-49b1-bc53-d15ec23e70ca None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:47.271687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 680/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:47.277057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19855-5e83-4461-b67e-485a10f2d2fc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:47.277485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19855-5e83-4461-b67e-485a10f2d2fc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:47.277575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19855-5e83-4461-b67e-485a10f2d2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:47.356119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-11d19855-5e83-4461-b67e-485a10f2d2fc None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:47.357382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-11d19855-5e83-4461-b67e-485a10f2d2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:47.466130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 675/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:34:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:50.970522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5901-a81e-403a-b148-068f4a4d3e0e None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:50.971423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5901-a81e-403a-b148-068f4a4d3e0e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:50.971853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5901-a81e-403a-b148-068f4a4d3e0e None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:50.974788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 681/1356] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:50.980507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17dfeb-e931-4c2a-ba44-79b3b232de3b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:50.980954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17dfeb-e931-4c2a-ba44-79b3b232de3b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:50.981072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17dfeb-e931-4c2a-ba44-79b3b232de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:51.024291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:51.062053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8a17dfeb-e931-4c2a-ba44-79b3b232de3b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:51.063552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8a17dfeb-e931-4c2a-ba44-79b3b232de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:51.174963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 676/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:51.228439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:51.229147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:51.229578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:51.231612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 682/1358] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 13 20:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:51.240119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b48bd-5091-4f06-974a-591694e0a820 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:51.240648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b48bd-5091-4f06-974a-591694e0a820 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:51.241484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b48bd-5091-4f06-974a-591694e0a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:51.327376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-896b48bd-5091-4f06-974a-591694e0a820 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:51.328570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-896b48bd-5091-4f06-974a-591694e0a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:51.381372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:51.456687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 677/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 13 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:51.464625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:51.466429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:51.625595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea9b4-551d-4e20-a6b7-1dd2bac95944 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:51.714169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:51.759105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:51.759807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:51.760083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:51.760349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:51.761960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:51.854840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:51.856499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b26d16-758e-47d1-838c-64a4badeff5f service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:51.875863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 683/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:54.088906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:54.089431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:54.089511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:54.090971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 678/1361] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:54.097268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ee79-60d5-44fc-87de-8b9d00b4814e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:54.098204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ee79-60d5-44fc-87de-8b9d00b4814e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:54.098204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ee79-60d5-44fc-87de-8b9d00b4814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:54.176632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1f29ee79-60d5-44fc-87de-8b9d00b4814e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:54.177970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1f29ee79-60d5-44fc-87de-8b9d00b4814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:54.227352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:54.295975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 684/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:54.343666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:54.345524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:54.532719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739950-09cb-496e-add3-f3a92d6ef333 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:54.548647 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:54.657759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:54.658410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:54.658694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:54.658993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:54.660655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:54.762134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:54.764227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182269-5774-4f8e-8334-abf8a1212e68 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:54.784348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 679/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:57.138312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a59df-5e8b-4207-9ceb-c01e51164325 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:57.139335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a59df-5e8b-4207-9ceb-c01e51164325 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:57.139335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a59df-5e8b-4207-9ceb-c01e51164325 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:57.140607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 685/1364] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:57.146936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151523be-8b29-4c6f-9181-b3efe1ff571f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:57.147422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151523be-8b29-4c6f-9181-b3efe1ff571f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:57.147689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151523be-8b29-4c6f-9181-b3efe1ff571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:57.162970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:57.216824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-151523be-8b29-4c6f-9181-b3efe1ff571f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:57.220791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-151523be-8b29-4c6f-9181-b3efe1ff571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:57.322452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 680/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:57.367489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:57.368163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:57.368527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:57.370876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 686/1366] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 13 20:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:57.376403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7101-32db-4124-929e-022faee72096 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:57.376896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7101-32db-4124-929e-022faee72096 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:57.377140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7101-32db-4124-929e-022faee72096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:57.456657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b5ec7101-32db-4124-929e-022faee72096 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:57.457855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b5ec7101-32db-4124-929e-022faee72096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:57.494681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:57.581645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 681/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 13 20:34:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:57.589354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:57.591878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:57.781388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f60e-0cbb-41c3-824b-72b8f40f088e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:57.804858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:57.906543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:57.907262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:57.907546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:57.907821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:57.909506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:58.007991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:58.009547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8dd5f-133b-4a65-b6a5-ac87919b2ea4 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:34:58.030940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 687/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:34:58.948835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38b10-2013-4b40-95de-e3bd15a4a88f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:58.949720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38b10-2013-4b40-95de-e3bd15a4a88f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:58.950212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38b10-2013-4b40-95de-e3bd15a4a88f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:58.951819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 682/1369] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:58.957037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125ee1a-e003-4fb2-8ebf-9236061b9c56 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:58.957797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125ee1a-e003-4fb2-8ebf-9236061b9c56 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:58.958218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125ee1a-e003-4fb2-8ebf-9236061b9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:58.990282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:59.026802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5125ee1a-e003-4fb2-8ebf-9236061b9c56 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:59.028051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5125ee1a-e003-4fb2-8ebf-9236061b9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:59.140328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 688/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:59.474651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:59.475119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:59.475540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:59.477239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 683/1371] 10.222.0.27 () {54 vars in 963 bytes} [Wed Jul 13 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:34:59.482455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b424ac-b391-485e-86bb-4ab4b818a300 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:59.483000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b424ac-b391-485e-86bb-4ab4b818a300 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:59.483463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b424ac-b391-485e-86bb-4ab4b818a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:59.560189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a1b424ac-b391-485e-86bb-4ab4b818a300 None None] MFA Rules not processed for user `d8d33da4251e47d8a330ef0e84ee0fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:34:59.561738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a1b424ac-b391-485e-86bb-4ab4b818a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:59.610862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:59.648860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 689/1372] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Jul 13 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:34:59.659765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:34:59.661520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:59.779494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8664e-cffd-4b95-ba75-ecae48d2d42f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:34:59.822376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:34:59.859670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:34:59.860452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:34:59.861744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:34:59.862152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:34:59.863933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:34:59.980360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:34:59.981997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592362c-3adb-4036-bc3d-6650b57c5728 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:00.001996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 684/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:00.126561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:00.127107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:00.127244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:00.128672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 690/1374] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:00.134414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c133b-6ac3-409c-91f6-2edc012221bf None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:00.134707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c133b-6ac3-409c-91f6-2edc012221bf None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:00.135016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c133b-6ac3-409c-91f6-2edc012221bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:00.200955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1a6c133b-6ac3-409c-91f6-2edc012221bf None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:00.202202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1a6c133b-6ac3-409c-91f6-2edc012221bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:00.223614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:00.313412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 685/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:00.360553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:00.362164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:00.521138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af41b60-c343-47c2-b0ff-7d3f0846f06e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:00.571674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:00.641025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:00.641679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:00.641962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:00.642234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:00.643966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:00.744771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:00.746543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a6da9-ba42-4b57-b5f1-4ee1bf8d866d service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:00.765392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 691/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:02.800760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:02.801694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:02.801981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:02.803525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 686/1377] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:02.809022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf9f6-c490-47ff-93db-b81f4b0d6086 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:02.809620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf9f6-c490-47ff-93db-b81f4b0d6086 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:02.809770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedf9f6-c490-47ff-93db-b81f4b0d6086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:02.884862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7bedf9f6-c490-47ff-93db-b81f4b0d6086 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:02.886070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7bedf9f6-c490-47ff-93db-b81f4b0d6086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:02.892814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:02.998955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 692/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:03.047239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:03.048844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:03.198192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e771dc-89d4-473e-a1a3-6be6845246a6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:03.202415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:03.320170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:03.321070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:03.321341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:03.321641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:03.323356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:03.439209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:03.442097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad049-61c9-42d4-a4cf-246ff7d45fb1 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:03.468651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 687/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:05.661654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:05.661654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:05.662095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:05.667799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 693/1380] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:05.669689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce78b56-f1b5-4ec8-b48f-76772281c8e6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:05.670176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce78b56-f1b5-4ec8-b48f-76772281c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:05.670257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce78b56-f1b5-4ec8-b48f-76772281c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:05.681394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:05.742012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-dce78b56-f1b5-4ec8-b48f-76772281c8e6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:05.743236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-dce78b56-f1b5-4ec8-b48f-76772281c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:05.862998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 688/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:05.902802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:05.904496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:06.049640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:06.061277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7322-c513-4076-bfc7-e464ba1a6b91 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:06.184391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:06.185039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:06.185314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:06.185584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:06.187234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:06.285390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:06.286901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d2ee-2690-46d4-bc73-714efa87e492 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:06.298430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:06.312625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:08.736993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:08.737553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:08.737553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:08.739031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 689/1383] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:08.746180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117ea-049e-410f-81f5-2886cdbb1d30 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:08.747251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117ea-049e-410f-81f5-2886cdbb1d30 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:08.747251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663117ea-049e-410f-81f5-2886cdbb1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:08.823684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-663117ea-049e-410f-81f5-2886cdbb1d30 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:08.825599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-663117ea-049e-410f-81f5-2886cdbb1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:08.939479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:08.994514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:08.996655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:09.101276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:09.162404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b333f6-6c1e-4fad-b3f5-1fef4fb6ff0a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:09.284381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:09.284978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:09.285273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:09.285563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:09.287348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:09.346132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:09.411300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:09.413327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14a0e-d671-43b6-8e1d-c513230e77eb service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:09.437022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 690/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:11.479170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:11.479541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:11.479866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:11.481364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 696/1386] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:11.486864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8effd1-adf3-4d7c-a29a-adb586334466 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:11.487423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8effd1-adf3-4d7c-a29a-adb586334466 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:11.487423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8effd1-adf3-4d7c-a29a-adb586334466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:11.553291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5b8effd1-adf3-4d7c-a29a-adb586334466 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:11.554526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5b8effd1-adf3-4d7c-a29a-adb586334466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:11.671300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 691/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:11.718140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:11.720161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:11.808935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:11.885641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4480ba-fa65-4e03-8ab3-a2b4db285cc3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:12.011069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:12.011697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:12.012023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:12.012375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:12.014052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:12.060546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:12.121362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:12.123318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36709-45e6-4b93-b33f-9185e8714f84 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:12.144123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 697/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:14.302452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:14.303006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:14.303098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:14.304505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 692/1389] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:14.310016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92786-591e-47e5-9b5a-6d6bab0ff417 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:14.310480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92786-591e-47e5-9b5a-6d6bab0ff417 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:14.310575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92786-591e-47e5-9b5a-6d6bab0ff417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:14.376062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-32c92786-591e-47e5-9b5a-6d6bab0ff417 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:14.377247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-32c92786-591e-47e5-9b5a-6d6bab0ff417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:14.473417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 698/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:14.518133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:14.519723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:14.552741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:14.673493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d581df-f913-4068-ac08-1ac05f5c3827 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:14.779278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:14.792211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:14.792939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:14.793217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:14.793572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:14.795242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:14.889348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:14.890895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc61a-94b5-46ca-aa8e-41f9bf168abb service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:14.910636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 693/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:15.040044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffbf85-5689-4c42-9f3d-deacb14b1dca None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:15.040382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffbf85-5689-4c42-9f3d-deacb14b1dca None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:15.040660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffbf85-5689-4c42-9f3d-deacb14b1dca None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:15.042215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 699/1392] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:15.048474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7901fa-17a1-4153-8056-c3debe9cee0c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:15.048850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7901fa-17a1-4153-8056-c3debe9cee0c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:15.049201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7901fa-17a1-4153-8056-c3debe9cee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:15.124116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-be7901fa-17a1-4153-8056-c3debe9cee0c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:15.125327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-be7901fa-17a1-4153-8056-c3debe9cee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:15.200231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:15.245180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 694/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:15.299625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c443-1121-4d9c-8408-85d751793047 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:15.299891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c443-1121-4d9c-8408-85d751793047 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:15.300185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c443-1121-4d9c-8408-85d751793047 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:15.301575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 700/1394] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 13 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:15.306776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666201-0b70-4a45-824d-d1ab54722bf6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:15.307296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666201-0b70-4a45-824d-d1ab54722bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:15.307399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666201-0b70-4a45-824d-d1ab54722bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:15.388207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6a666201-0b70-4a45-824d-d1ab54722bf6 None None] MFA Rules not processed for user `a4379a727a73403487d9a3adc342a06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:15.389410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6a666201-0b70-4a45-824d-d1ab54722bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:15.466106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 695/1395] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 13 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:15.474136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c443-1121-4d9c-8408-85d751793047 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:15.475825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3624c443-1121-4d9c-8408-85d751793047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:15.490949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:15.586701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c443-1121-4d9c-8408-85d751793047 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:15.665856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:15.666509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:15.666769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:15.667071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:15.669441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:15.739853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:15.783196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:15.784651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98fa2-3b07-450c-a9db-77757ce58c9a service glance] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:15.803170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 701/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:16.525913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682825-c24c-4175-b2d8-32739c728a77 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:16.526400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682825-c24c-4175-b2d8-32739c728a77 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:16.526601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23682825-c24c-4175-b2d8-32739c728a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:16.598292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-23682825-c24c-4175-b2d8-32739c728a77 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:16.599560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-23682825-c24c-4175-b2d8-32739c728a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:16.609386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:16.694247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 696/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:16.737339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:16.737857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:16.737857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:16.739317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 702/1398] 10.222.0.27 () {54 vars in 942 bytes} [Wed Jul 13 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:35:16.745777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ce61-61c5-4f4a-a093-d5431cb5c490 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:16.746132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ce61-61c5-4f4a-a093-d5431cb5c490 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:16.746386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9ce61-61c5-4f4a-a093-d5431cb5c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:16.824218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9ac9ce61-61c5-4f4a-a093-d5431cb5c490 None None] MFA Rules not processed for user `588e6f0b3d6a452ea8a197cc6930dc60`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:16.825421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9ac9ce61-61c5-4f4a-a093-d5431cb5c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:16.915283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:16.938217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 697/1399] 10.222.0.27 () {58 vars in 1039 bytes} [Wed Jul 13 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:16.947798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:16.949389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:16.962455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bce-bc80-4f93-a877-19519e2837de None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:16.962750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bce-bc80-4f93-a877-19519e2837de None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:16.963046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bce-bc80-4f93-a877-19519e2837de None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:16.964496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 698/1400] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:35:16.969502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:16.969794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:16.970070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:17.036349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:17.037554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:17.087406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a1c4-0f86-4676-87b4-c4490339c1e5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:17.124482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:17.137232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 699/1401] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:35:17.182338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:17.183588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:17.204647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:17.205228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:17.205515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:17.205794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:17.207864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:17.247777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:17.291959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:17.293632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af0878-2b84-4fd4-ac17-4ad777355c7a service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:17.298177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18bbe2-8faf-4eb1-9fee-6683055a8357 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:17.301771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 703/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:35:17.423440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:17.424255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:17.424626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:17.424866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:17.426758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:17.495807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:17.531099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:17.532736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6271e-a1f0-4b32-954e-73e05d629ea4 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:17.552061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 700/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:35:19.669400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:19.669957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:19.669957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:19.671408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 704/1404] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:19.676892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccb05-43f4-4bee-9238-98b3496d6989 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:19.677403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccb05-43f4-4bee-9238-98b3496d6989 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:19.677759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccb05-43f4-4bee-9238-98b3496d6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:19.752893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-fe0ccb05-43f4-4bee-9238-98b3496d6989 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:19.754121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fe0ccb05-43f4-4bee-9238-98b3496d6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:19.868707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 701/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:19.932779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:19.935390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:20.025711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:20.127564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22af68-9e4b-4c9d-9fde-f3314c353ba5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:20.261976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:20.262696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:20.262696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:20.263241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:20.264933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:20.297987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:20.363882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:20.365673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd2c7-4ba8-43ac-bc73-300ec675a6ef service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:20.385661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 705/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:22.459060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:22.459623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:22.459623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:22.461398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 702/1407] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:22.467052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7211-1e21-4312-bcd2-a0a093ae603e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:22.467905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7211-1e21-4312-bcd2-a0a093ae603e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:22.468351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7211-1e21-4312-bcd2-a0a093ae603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:22.536532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-229f7211-1e21-4312-bcd2-a0a093ae603e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:22.538081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-229f7211-1e21-4312-bcd2-a0a093ae603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:22.645714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 706/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:35:22.689905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:22.691475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:22.731523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:22.860262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21f42-aa64-43c9-a81b-71c2b9822219 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:22.990446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:22.996819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:22.997479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:22.997756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:22.998027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:22.999887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:23.098597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:23.100270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ebb82-657a-46d2-adfc-a6e5cd113817 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:23.118835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 703/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:32.643730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:33.116462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=47 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:39.273525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352728-c99d-4f4f-a8e6-74069024346a None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:39.274077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352728-c99d-4f4f-a8e6-74069024346a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:39.274077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d352728-c99d-4f4f-a8e6-74069024346a None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:39.276085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 707/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jul 13 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:39.281404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13cb9-7274-4044-8044-4a745581496a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:39.281859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13cb9-7274-4044-8044-4a745581496a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:39.281955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13cb9-7274-4044-8044-4a745581496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:39.359485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-91e13cb9-7274-4044-8044-4a745581496a None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:39.360705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-91e13cb9-7274-4044-8044-4a745581496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:39.468367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 704/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 13 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:39.485935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89c19-098b-4743-8e79-943a58aa6558 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:39.486296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89c19-098b-4743-8e79-943a58aa6558 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:39.486617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b89c19-098b-4743-8e79-943a58aa6558 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:39.488723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 708/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jul 13 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:39.495964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f774ea-9a60-4902-860f-32a165a60909 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:39.496254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f774ea-9a60-4902-860f-32a165a60909 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:39.496529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f774ea-9a60-4902-860f-32a165a60909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:39.575070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:39.577842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-07f774ea-9a60-4902-860f-32a165a60909 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:39.579625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-07f774ea-9a60-4902-860f-32a165a60909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:39.711180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 13 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:42.191902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:42.192467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:42.192467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:42.193835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:42.200188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5184c-ab19-42e7-933c-a22a49ea1d96 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:42.200614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5184c-ab19-42e7-933c-a22a49ea1d96 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:42.200804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5184c-ab19-42e7-933c-a22a49ea1d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:42.271753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ebc5184c-ab19-42e7-933c-a22a49ea1d96 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:42.272986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ebc5184c-ab19-42e7-933c-a22a49ea1d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:42.346885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:42.392028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:42.434772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:42.436415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:42.594436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f913567-e5d8-4189-adbd-3d2f52312530 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:42.671650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:42.714957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:42.715605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:42.715882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:42.716150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:42.717806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:42.812031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:42.813644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db46f2-d4f1-41b8-9abb-a25bbe2949ba service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:42.833511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 710/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:43.729264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:43.730141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:43.730141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:43.732402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:43.737663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce22-0c65-4d88-b5e8-0e1c8f5aa2c6 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:43.738103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce22-0c65-4d88-b5e8-0e1c8f5aa2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:43.738208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce22-0c65-4d88-b5e8-0e1c8f5aa2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:43.819666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-dc07ce22-0c65-4d88-b5e8-0e1c8f5aa2c6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:43.820892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-dc07ce22-0c65-4d88-b5e8-0e1c8f5aa2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:43.850203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:43.927081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:44.092326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:44.093934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:44.253681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4ce2-1a50-4082-b116-7261c2238444 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:44.299082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:44.377092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:44.377739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:44.378023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:44.378299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:44.379956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:44.473009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:44.474634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205a2c-d390-4f07-8154-f2fc62fedb33 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:44.492971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 708/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:45.377490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:45.378351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:45.378508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:45.380666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:45.387410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac08c6-1cb5-4086-8523-b4504d5da582 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:45.387835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac08c6-1cb5-4086-8523-b4504d5da582 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:45.387989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac08c6-1cb5-4086-8523-b4504d5da582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:45.446269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:45.470979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7eac08c6-1cb5-4086-8523-b4504d5da582 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:45.472210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7eac08c6-1cb5-4086-8523-b4504d5da582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:45.581516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:45.743903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:45.746510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:45.910579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806db7f8-9416-40c5-a28e-031de07ba603 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:45.930068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:46.041730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:46.042620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:46.042978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:46.043301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:46.045885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:46.150159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:46.151828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cc9a-f382-4b0f-9bee-eab8372e4d21 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:46.171030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 713/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:47.025975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:47.026992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:47.026992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:47.029109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:47.035294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73592d-3ecb-4c29-8de2-ff798448e835 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:47.036029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73592d-3ecb-4c29-8de2-ff798448e835 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:47.036182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73592d-3ecb-4c29-8de2-ff798448e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:47.058367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:47.124614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8e73592d-3ecb-4c29-8de2-ff798448e835 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:47.126308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8e73592d-3ecb-4c29-8de2-ff798448e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:47.233277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:47.385255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:47.386729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:47.517893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:47.555348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975735d3-9aab-4d3a-9da3-1a6ec4c417b4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:47.676015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:47.676677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:47.676961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:47.677242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:47.678910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:47.773981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:47.789411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:47.791189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913af8b7-929f-48ed-a9a9-74330399dcea service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:47.810654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 711/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:48.684737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:48.685237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:48.685237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:48.687280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:48.694362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c87a9-2745-4ab9-a3d0-1357441afad8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:48.694806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c87a9-2745-4ab9-a3d0-1357441afad8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:48.694937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c87a9-2745-4ab9-a3d0-1357441afad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:48.775961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b38c87a9-2745-4ab9-a3d0-1357441afad8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:48.777171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b38c87a9-2745-4ab9-a3d0-1357441afad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:48.884346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:35:49.036228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:49.037749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:49.128528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:49.194646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000665d-bedc-411f-859a-32b4a68ed07b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:49.322048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:49.322902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:49.323364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:49.323769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:49.326320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:49.389890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:49.436960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:49.438589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16cd63-0a3f-4fd5-8a66-52768f019bb7 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:49.463956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 716/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:50.311711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:50.312743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:50.312743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:50.314855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:50.320929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382541f-b052-495f-bb61-f3ae5d18c3ef None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:50.321442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382541f-b052-495f-bb61-f3ae5d18c3ef None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:50.321561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382541f-b052-495f-bb61-f3ae5d18c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:50.408863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f382541f-b052-495f-bb61-f3ae5d18c3ef None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:50.410080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f382541f-b052-495f-bb61-f3ae5d18c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:50.523429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:50.671362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:50.672890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:50.723101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:50.824017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e47f0-c4fc-4f38-9df8-bef2e7ff7355 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:50.949754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:50.950401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:50.950684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:50.950961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:50.952634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:50.959667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:51.044694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:51.046292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2e90-d38d-4cf8-be9d-7ccb65a5ef98 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:51.066303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 714/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:51.898427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:51.899001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:51.899001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:51.900360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:51.906171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c120b1-08a2-477f-a684-67a9b1c00f5e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:51.906626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c120b1-08a2-477f-a684-67a9b1c00f5e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:51.906769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c120b1-08a2-477f-a684-67a9b1c00f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:51.992344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-81c120b1-08a2-477f-a684-67a9b1c00f5e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:51.993747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-81c120b1-08a2-477f-a684-67a9b1c00f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:52.069875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:52.106361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:52.256088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:52.258781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:52.284809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:52.425616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144e70-8aab-42a8-857a-b0840b1f2a85 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:52.524052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:52.550752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:52.551448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:52.551724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:52.552003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:52.553688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:52.647512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:52.649134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bff54-9e9e-45fa-a1ba-c11dc7998d82 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:52.668060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 719/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:53.472986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:53.473585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:53.473585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:53.475723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:53.486211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edd243-cc6f-42c7-b786-67f0f279a298 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:53.486707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edd243-cc6f-42c7-b786-67f0f279a298 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:53.486822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edd243-cc6f-42c7-b786-67f0f279a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:53.579484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e2edd243-cc6f-42c7-b786-67f0f279a298 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:53.581264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e2edd243-cc6f-42c7-b786-67f0f279a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:53.627132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:53.687305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:53.845187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:53.847502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:54.120099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b736-2f54-4e22-9fe9-3ee5c6ff5a0b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:54.189392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:54.250786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:54.251456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:54.251735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:54.252006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:54.253639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:54.347382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:54.349146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80d052-14e1-42fe-95cc-e508b0b38195 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:54.368657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 717/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:55.174780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:55.175408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:55.175408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:55.176782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:55.183891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60565f9-a57c-4b8e-a59e-5d01aba29be2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:55.184641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60565f9-a57c-4b8e-a59e-5d01aba29be2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:55.184813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60565f9-a57c-4b8e-a59e-5d01aba29be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:55.268842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f60565f9-a57c-4b8e-a59e-5d01aba29be2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:55.270054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f60565f9-a57c-4b8e-a59e-5d01aba29be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:55.272319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:55.375771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:55.528840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:55.531150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:55.695711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9bb6-c87d-4362-8d4b-6d0da0eab0c3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:55.723136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:55.819414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:55.819981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:55.820262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:55.820528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:55.822380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:55.913803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:55.915518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675604b-ec1e-4c58-9df4-9cc1e2996d8c service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:55.933689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 722/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:35:57.843296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:57.843852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:57.843852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:57.845572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:35:57.851954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bd5f-79b6-40bd-9afe-4acd70607702 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:57.852862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bd5f-79b6-40bd-9afe-4acd70607702 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:57.852978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3bd5f-79b6-40bd-9afe-4acd70607702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:57.898710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:57.924034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-dbf3bd5f-79b6-40bd-9afe-4acd70607702 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:35:57.925151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-dbf3bd5f-79b6-40bd-9afe-4acd70607702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:58.022554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:35:58.063084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:35:58.064607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:58.185226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b838c8f-ff26-4013-880e-7a82213e6613 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:35:58.218410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:35:58.263219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:35:58.263869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:35:58.264147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:35:58.264423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:35:58.266072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:35:58.382707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:35:58.384399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea0ad-7d11-4251-9f90-f46537769dfd service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:35:58.403719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 720/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:36:00.549531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:00.550082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:00.550082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:00.551508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:00.557499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b13730-0e90-45a4-91c4-b9fd415b570d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:00.557956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b13730-0e90-45a4-91c4-b9fd415b570d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:00.558069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b13730-0e90-45a4-91c4-b9fd415b570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:00.629022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-34b13730-0e90-45a4-91c4-b9fd415b570d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:00.630195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-34b13730-0e90-45a4-91c4-b9fd415b570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:00.643626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:00.736063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:00.778299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:00.780810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:00.905354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2a458-27e6-40c7-9852-edc9d9010b2f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:00.917962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:00.988884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:00.989533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:00.989808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:00.990085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:00.991777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:01.233789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:01.235279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f641f2-958c-4e85-a398-09163fa3c7c2 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:01.258237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 725/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:03.612017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:03.612917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:03.612917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:03.614794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:03.622309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120cfb-ba65-413d-84bd-d425009996be None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:03.622890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120cfb-ba65-413d-84bd-d425009996be None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:03.622890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120cfb-ba65-413d-84bd-d425009996be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:03.677242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:03.696103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-76120cfb-ba65-413d-84bd-d425009996be None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:03.697450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-76120cfb-ba65-413d-84bd-d425009996be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:03.798940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:03.838825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:03.840432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:03.952213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d355c61-323b-41ae-b24e-7b3a22ef38a2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:03.992370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:04.027884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:04.028497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:04.028795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:04.029071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:04.030677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:04.147696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:04.149644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ad416-7652-4bcb-b226-6b6611d75a0b service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:04.169296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 723/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:06.341622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:06.342252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:06.342252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:06.343672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:06.350289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783283-faeb-4582-866e-10cefadc0646 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:06.351054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783283-faeb-4582-866e-10cefadc0646 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:06.351248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783283-faeb-4582-866e-10cefadc0646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:06.419204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-72783283-faeb-4582-866e-10cefadc0646 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:06.420424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-72783283-faeb-4582-866e-10cefadc0646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:06.442402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:06.535472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:06.575015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:06.576530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:06.686880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaa72a-1c63-4782-afa3-89c7f827ce7c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:06.709288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:06.776922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:06.777534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:06.777839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:06.778107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:06.779946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:06.888736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:06.890160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac420d-b90e-42f0-a2c7-f6bbee6da31f service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:06.912802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 728/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:09.030170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:09.030720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:09.030720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:09.033038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:09.042141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509695-96ff-477e-9aa3-b1768bb60846 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:09.042885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509695-96ff-477e-9aa3-b1768bb60846 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:09.043012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e509695-96ff-477e-9aa3-b1768bb60846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:09.115158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:09.119098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-3e509695-96ff-477e-9aa3-b1768bb60846 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:09.120672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3e509695-96ff-477e-9aa3-b1768bb60846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:09.220828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:09.257524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:09.259358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:09.365297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81ff75-83d7-4816-a341-0a6df2fa1009 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:09.423324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:09.449545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:09.450188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:09.450469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:09.450743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:09.452411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:09.562699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:09.564222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50df684-fa94-4f43-9cd3-940c2e6c489b service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:09.582779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 726/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:11.674385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:11.675250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:11.675250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:11.676451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:11.682648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e862-79d9-4220-a3f3-b93211e0009b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:11.683101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e862-79d9-4220-a3f3-b93211e0009b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:11.683271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e862-79d9-4220-a3f3-b93211e0009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:11.749050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3a38e862-79d9-4220-a3f3-b93211e0009b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:11.750303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3a38e862-79d9-4220-a3f3-b93211e0009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:11.780190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:11.847210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:11.885960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:11.887534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:11.998487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da702b55-c244-4f1e-b6a1-c045e6ceebf0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:12.028518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:12.076317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:12.076961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:12.077243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:12.077516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:12.079179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:12.194707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:12.196234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa131-d60a-4ac0-a42d-5e7de1969baa service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:12.215357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 731/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:14.279423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:14.280037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:14.280037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:14.281409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:14.288044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9980-fc4c-48e7-8a47-d8b7d0b9925a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:14.288765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9980-fc4c-48e7-8a47-d8b7d0b9925a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:14.288917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec9980-fc4c-48e7-8a47-d8b7d0b9925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:14.360769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c0ec9980-fc4c-48e7-8a47-d8b7d0b9925a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:14.361968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c0ec9980-fc4c-48e7-8a47-d8b7d0b9925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:14.370599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:14.473939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:14.511597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:14.513132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:14.638748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314367c4-bd01-4c6a-a30b-9287b37a293e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:14.697545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:14.717067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:14.717711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:14.717991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:14.718263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:14.720240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:14.839834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:14.841286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23b0dc-624e-44cc-ade9-b1fcef3a64b7 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:14.861814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 729/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:16.906269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:16.907150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:16.907336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:16.909658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:16.915428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653cab-fc70-4d47-9f72-b44f52940a8d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:16.915873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653cab-fc70-4d47-9f72-b44f52940a8d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:16.915873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653cab-fc70-4d47-9f72-b44f52940a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:16.983440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e8653cab-fc70-4d47-9f72-b44f52940a8d None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:16.985662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e8653cab-fc70-4d47-9f72-b44f52940a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:17.034716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:17.111957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:36:17.150871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:17.152944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:17.271933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd764c2-d3fd-48a9-93de-b08a66c42b42 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:17.313118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:17.353896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:17.354553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:17.354828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:17.355130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:17.356772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:17.488847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:17.490296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3991-76fa-48c4-b7a8-6d7c7e04a970 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:17.508896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 734/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:19.567285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:19.567874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:19.567874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:19.569230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 20:36:19.574704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba5e3-6166-4058-a50d-3e73d17438de None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:19.575184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba5e3-6166-4058-a50d-3e73d17438de None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:19.575280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aba5e3-6166-4058-a50d-3e73d17438de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:19.642592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c1aba5e3-6166-4058-a50d-3e73d17438de None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:19.643814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c1aba5e3-6166-4058-a50d-3e73d17438de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:19.663570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:19.750622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:19.792032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:19.794328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:19.914101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073a17-9de2-4981-97e7-51fc67a39ae0 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:19.986379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:19.994658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:19.995340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:19.995634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:19.995897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:19.997532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:20.118007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:20.119521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a3807-8b67-4b49-b753-203474777693 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:20.139422 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 732/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:22.168182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:22.168810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:22.168810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:22.170905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:22.178836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5d4b-404d-4830-a794-a860662d2f62 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:22.179341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5d4b-404d-4830-a794-a860662d2f62 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:22.179592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5d4b-404d-4830-a794-a860662d2f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:22.251386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6d2f5d4b-404d-4830-a794-a860662d2f62 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:22.252605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6d2f5d4b-404d-4830-a794-a860662d2f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:22.302997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:22.356601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:22.398769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:22.400324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:22.517660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11199-c985-45a4-a5c4-6727ee093e7d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:22.565988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:22.596000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:22.596659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:22.596960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:22.597231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:22.598900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:22.718275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:22.720086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0162d-0169-461f-a406-1af787f871a3 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:22.747295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 737/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:36:32.354640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=22 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:32.743344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=66 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:42.383874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d808-2d64-43a4-a2bc-4237256acdb7 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:42.384436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d808-2d64-43a4-a2bc-4237256acdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:42.384572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d808-2d64-43a4-a2bc-4237256acdb7 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:42.385894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 734/1471] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:42.392293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a35fc-18c9-443c-9919-353f4c58d845 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:42.392755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a35fc-18c9-443c-9919-353f4c58d845 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:42.392860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a35fc-18c9-443c-9919-353f4c58d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:42.460076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7c1a35fc-18c9-443c-9919-353f4c58d845 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:42.461274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7c1a35fc-18c9-443c-9919-353f4c58d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:42.568257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 738/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:42.654622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:42.655403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:42.655752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:42.657783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 735/1473] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 13 20:36:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:42.664510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f688-eef8-424f-b988-44d2cf89098c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:42.664794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f688-eef8-424f-b988-44d2cf89098c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:42.665097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68f688-eef8-424f-b988-44d2cf89098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:42.748441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2e68f688-eef8-424f-b988-44d2cf89098c None None] MFA Rules not processed for user `a4379a727a73403487d9a3adc342a06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:42.749634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2e68f688-eef8-424f-b988-44d2cf89098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:42.769188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:42.836581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 739/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 13 20:36:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:42.844455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:42.846016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:42.951933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b1187-784a-4407-b12a-f0e74963775a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:43.031238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:43.032181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:43.032597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:43.033012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:43.035593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:43.107988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:43.169138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:43.170641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b0fa5-4221-4399-9466-fcebd22cc69d service glance] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:43.190892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 736/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:45.308197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:45.309112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:45.309112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:45.311264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 740/1476] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:45.317594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced59a3-113e-4102-973d-d08c39065ae5 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:45.318032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced59a3-113e-4102-973d-d08c39065ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:45.318280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced59a3-113e-4102-973d-d08c39065ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:45.400541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2ced59a3-113e-4102-973d-d08c39065ae5 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:45.401974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2ced59a3-113e-4102-973d-d08c39065ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:45.504117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 737/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:45.539366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:45.540916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:45.673936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615797-0c5a-416e-bd4d-cd244cb2236c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:45.731053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:45.777814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:45.777967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:45.778214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:45.778490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:45.779268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:45.781006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:36:45.781006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:36:45.781006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:36:45.782160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93169407-8eb3-4b6a-bfa2-12f949d1deb4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:45.801379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 741/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 13 20:36:45 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:36:47.819115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:47.819663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:47.819663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:47.821086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 738/1479] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:47.826643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1404-0bb3-4cfe-a505-5c715f0d5a38 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:47.827130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1404-0bb3-4cfe-a505-5c715f0d5a38 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:47.827233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1404-0bb3-4cfe-a505-5c715f0d5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:47.900730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9c9c1404-0bb3-4cfe-a505-5c715f0d5a38 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:47.901940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9c9c1404-0bb3-4cfe-a505-5c715f0d5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:48.003569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 742/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:48.047858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:48.049628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:48.061301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:48.205036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd01cf-99ed-44d2-bda6-0267909d8fa9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:48.288431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:48.322020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:48.322691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:48.322978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:48.323278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:48.324907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:48.414604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:48.416267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0309cba-7300-429a-9e08-6d392a2bb5b4 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:48.436157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 739/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:50.659003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:50.659638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:50.659638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:50.660945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 743/1482] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:50.666849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394559-d79d-4358-b9c8-4d4378efe9c6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:50.667338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394559-d79d-4358-b9c8-4d4378efe9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:50.667448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394559-d79d-4358-b9c8-4d4378efe9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:50.744218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-50394559-d79d-4358-b9c8-4d4378efe9c6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:50.745456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-50394559-d79d-4358-b9c8-4d4378efe9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:50.791904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:50.852661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 740/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:50.889116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:50.890619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:50.915001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:51.004506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05aae-2b68-4915-af5c-814ecf1f1981 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:51.088022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:51.088964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:51.089373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:51.089784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:51.092472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:51.182942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:51.223152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:51.224655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132db0cf-d9b4-4fa3-a6cc-fe898f67a324 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:51.245085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 744/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:53.335921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:53.336842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:53.336842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:53.339045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 741/1485] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:53.347630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f0c-bc35-403f-966f-494599528f95 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:53.348103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f0c-bc35-403f-966f-494599528f95 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:53.348396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4f0c-bc35-403f-966f-494599528f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:53.418242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a73f4f0c-bc35-403f-966f-494599528f95 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:53.419498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a73f4f0c-bc35-403f-966f-494599528f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:53.545528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 745/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:36:53.585148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:53.587454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:53.710476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24895ab4-d0ba-4b2d-ab8c-a0a5a22dbbd1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:53.787156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:53.789456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:53.790161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:53.790453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:53.790737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:53.793160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:53.911272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:53.913030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dadef-d264-4833-adea-a28a8069fbde service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:53.932940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 742/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:56.089731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:56.090326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:56.090326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:56.091734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 746/1488] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:56.098436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bef92-2b3d-4287-a241-d215cc10014c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:56.099162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bef92-2b3d-4287-a241-d215cc10014c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:56.099287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bef92-2b3d-4287-a241-d215cc10014c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:56.172536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4e3bef92-2b3d-4287-a241-d215cc10014c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:56.173757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4e3bef92-2b3d-4287-a241-d215cc10014c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:56.236567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:56.285814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 743/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:56.332009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:56.333853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:56.373344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:56.443608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e9ca-c20d-4583-8d16-deba29730f88 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:56.529968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:56.530620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:56.530894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:56.531203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:56.532844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:56.615667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:56.646847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:56.648244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0bdd3-f0db-4e21-9d99-4496f5953b03 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:56.668768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 747/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:36:58.872113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:58.872706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:58.872706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:58.874058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 744/1491] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 13 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:36:58.880557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e625b6-dc5a-4e1c-bd9c-f023d5b6f149 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:58.881273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e625b6-dc5a-4e1c-bd9c-f023d5b6f149 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:58.881463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e625b6-dc5a-4e1c-bd9c-f023d5b6f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:58.959119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e9e625b6-dc5a-4e1c-bd9c-f023d5b6f149 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:36:58.960339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e9e625b6-dc5a-4e1c-bd9c-f023d5b6f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:59.063458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 748/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 13 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:36:59.102873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:36:59.104493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:59.210406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd06ff1-fc56-4ca3-bf2c-f9375449c2a7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:36:59.300482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:36:59.301375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:36:59.301744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:36:59.302275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:36:59.303986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:36:59.313501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:36:59.423483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:36:59.424935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459711c5-5f3a-41cd-822c-a3752c922730 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:36:59.444093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 745/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:37:09.061317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=82 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:37:09.441269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=50 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:26.093733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:26.094414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:26.094414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:26.172523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:38:26.173814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:26.278637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 749/1494] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:38:26.287347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:26.288220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:26.288505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:26.365273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:38:26.366438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:26.467997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 746/1495] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:38:26.475750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:26.477616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:26.492864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85cbcd-0b42-452f-9739-7a16d1925861 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:26.562042 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:26.597047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:26.597707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:26.597988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:26.598259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:26.598984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:38:26.599312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:26.600330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:26.600330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:38:26.600330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:38:26.601220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:26.612675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 750/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:38:26.621240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:26.631041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85aab1-277c-482c-9c36-6666f5232ff8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:26.706030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:26.739749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:26.740408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:26.740687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:26.740950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:26.741624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:26.743402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:26.743402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:38:26.743402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:38:26.744600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:26.802356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 747/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:38:26 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:38:26.806834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:26.808514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:26.843245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7f23-c856-4877-8013-4e4892a8a8e0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:26.948997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:26.949975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:26.950362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:26.950757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:26.951830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:26.953413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:26.953413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:38:26.953413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:38:26.955281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:27.000304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 751/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:38:26 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:38:27.004697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:27.006257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.067587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f1cfc-9a88-4829-ade8-d3be1a16bda0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:27.155122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:27.170400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:27.171407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.171796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.172176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.173397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:27.174483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:27.174483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:38:27.174483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:38:27.175423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:27.188241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 748/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:38:27.192524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:27.194050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.206429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d87ba-419c-4b66-8800-cab489f753ec admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:27.231895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:27.305262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:27.305929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.306211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.306481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.307267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:27.308259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:27.308259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:38:27.308259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:38:27.309151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c68f5-812f-4ff3-bfb7-655ec545e87d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:27.321846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 752/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:38:27.328586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:27.330890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.373358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a6414-0931-4017-9f83-fe29c541c605 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:27.475499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:27.476326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.476609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.476884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] PATH_INFO: `/v3/projects/27f70bd6324e433bb7ec6e9b789e64e5/users/d9b3f833ae10495b962b6e424d9a84e2/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.504921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f70bd6324e433bb7ec6e9b789e64e5, user_id=d9b3f833ae10495b962b6e424d9a84e2, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:27.505972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:27.505972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:38:27.505972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:38:27.507975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d43223-9764-4164-b0c6-b9bdbb0ebaef admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:27.544004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 749/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:38:27 2022] PUT /identity/v3/projects/27f70bd6324e433bb7ec6e9b789e64e5/users/d9b3f833ae10495b962b6e424d9a84e2/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:38:27.556511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0caf9-f5b4-47d7-bd5b-85e5f04a7f22 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.556845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0caf9-f5b4-47d7-bd5b-85e5f04a7f22 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.557263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0caf9-f5b4-47d7-bd5b-85e5f04a7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.621461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2df0caf9-f5b4-47d7-bd5b-85e5f04a7f22 None None] MFA Rules not processed for user `d9b3f833ae10495b962b6e424d9a84e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:38:27.622688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2df0caf9-f5b4-47d7-bd5b-85e5f04a7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.705190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 753/1502] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:38:27.724287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.724628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.725006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.727107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 750/1503] 10.222.0.27 () {54 vars in 963 bytes} [Wed Jul 13 20:38:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:38:27.734749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884ec1-2134-4f28-8724-0c55c77b1b9c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:27.735178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884ec1-2134-4f28-8724-0c55c77b1b9c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:27.735664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884ec1-2134-4f28-8724-0c55c77b1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:27.767949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:27.826498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2f884ec1-2134-4f28-8724-0c55c77b1b9c None None] MFA Rules not processed for user `d8d33da4251e47d8a330ef0e84ee0fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:38:27.827768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2f884ec1-2134-4f28-8724-0c55c77b1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.905344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 754/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Jul 13 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:38:27.918195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:27.920635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:27.976222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:28.032882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a3fb3-9858-40a1-8dc0-d8535228afd3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:28.118649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:28.119343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:28.119627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:28.119901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:28.121567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:28.222204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:28.223731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:28.227205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:28.242462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 751/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:38:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:38:28.284098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71703fa-dca1-4cc2-8e07-48195747ccbf None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:28.284549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71703fa-dca1-4cc2-8e07-48195747ccbf None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:28.284549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71703fa-dca1-4cc2-8e07-48195747ccbf None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:28.285867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 755/1506] 10.222.0.27 () {52 vars in 829 bytes} [Wed Jul 13 20:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:38:28.289826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:28.291079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:28.393030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee19a-ee6b-4f29-a122-7ee42fd65d05 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:28.490352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:28.491266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:28.491547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:28.491821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] PATH_INFO: `/v3/users/d9b3f833ae10495b962b6e424d9a84e2` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:28.504282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b3f833ae10495b962b6e424d9a84e2)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:28.505312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:28.505312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:38:28.505312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:38:28.506529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:28.516499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:28.574444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b3f833ae10495b962b6e424d9a84e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:28.574904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b3f833ae10495b962b6e424d9a84e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:28.587321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b3f833ae10495b962b6e424d9a84e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:28.587763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b3f833ae10495b962b6e424d9a84e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:28.607172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b3f833ae10495b962b6e424d9a84e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:28.627735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 752/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:38:28 2022] DELETE /identity/v3/users/d9b3f833ae10495b962b6e424d9a84e2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:38:28.632872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:28.633159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:28.633459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:28.690338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:38:28.691602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:28.771150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:28.792085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 756/1508] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:38:28.803444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:28.804675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:28.912230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9250e-9e4b-4a15-bf29-b9e31c61d2cf admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:28.978579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:29.004182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:29.004830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:29.005119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:29.005393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:29.007065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:29.123296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:29.124756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d17eb2-9380-4f30-bcab-4219db02ee0b service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:29.145284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 753/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:38:29.521523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:38:29.522859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:38:29.535781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58327c9-6b19-4ea6-9b04-75fd69ad60ef None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:38:29.633858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:38:29.634771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:38:29.635083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:38:29.635349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] PATH_INFO: `/v3/projects/27f70bd6324e433bb7ec6e9b789e64e5` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:38:29.645911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f70bd6324e433bb7ec6e9b789e64e5)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:38:29.646944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:38:29.646944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:38:29.646944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:38:29.648194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:38:29.715647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f70bd6324e433bb7ec6e9b789e64e5', 'request_id': 'req-ce7eff31-bcfa-4a9a-9999-41f39de5578f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:29.724720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f70bd6324e433bb7ec6e9b789e64e5', 'request_id': 'req-ce7eff31-bcfa-4a9a-9999-41f39de5578f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:29.739893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f70bd6324e433bb7ec6e9b789e64e5', 'request_id': 'req-ce7eff31-bcfa-4a9a-9999-41f39de5578f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:29.766381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] The token cache is being invalidate because project 27f70bd6324e433bb7ec6e9b789e64e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:38:29.766608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:29.767172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ce7eff31-bcfa-4a9a-9999-41f39de5578f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:38:29.768612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 757/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:38:29 2022] DELETE /identity/v3/projects/27f70bd6324e433bb7ec6e9b789e64e5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:38:39.142567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=62 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:38:39.764095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:40:15.267182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:15.267821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:15.267821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:15.269273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:15.274589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc057eb-bff2-404a-a6f2-ebaf792672b5 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:15.275099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc057eb-bff2-404a-a6f2-ebaf792672b5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:15.275202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc057eb-bff2-404a-a6f2-ebaf792672b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:15.358029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-cfc057eb-bff2-404a-a6f2-ebaf792672b5 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:15.359264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cfc057eb-bff2-404a-a6f2-ebaf792672b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:15.493377 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:40:15.648010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:15.650670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:15.788192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdf16-85ed-45d0-8d4a-cbad05018a11 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:15.793848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:15.794489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:15.794770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:15.795079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:15.803877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:15.805459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4282b-f8dc-49b1-b1af-4ab6e89007f0 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:15.815353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 755/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:40:16.646030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cdc3-bb57-4ba0-a912-f680b7a512ba None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:16.646599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cdc3-bb57-4ba0-a912-f680b7a512ba None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:16.646599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2cdc3-bb57-4ba0-a912-f680b7a512ba None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:16.648034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:16.653863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236064-6157-4bca-9066-c7147acfb1d1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:16.654311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236064-6157-4bca-9066-c7147acfb1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:16.654418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57236064-6157-4bca-9066-c7147acfb1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:16.680624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-57236064-6157-4bca-9066-c7147acfb1d1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:16.681861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-57236064-6157-4bca-9066-c7147acfb1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:16.691632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:16.855702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cdc3-bb57-4ba0-a912-f680b7a512ba None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:16.873334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2cdc3-bb57-4ba0-a912-f680b7a512ba None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:16.879860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:16.880523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:16.880808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:16.881090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:16.889818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:16.891483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5f74e-f6b7-4352-a1fd-b97a9ad4e1df service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:16.901675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 760/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:17.255002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b276-8c91-49d7-b48f-e03fd6bb6fcc None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:17.255269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b276-8c91-49d7-b48f-e03fd6bb6fcc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:17.255590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b276-8c91-49d7-b48f-e03fd6bb6fcc None None] PATH_INFO: `/v3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:17.257561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 757/1517] 10.222.0.50 () {54 vars in 925 bytes} [Wed Jul 13 20:40:17 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:40:17.264439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5f47-8644-4e28-bdf4-42947ed00ff4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:17.264727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5f47-8644-4e28-bdf4-42947ed00ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:17.265000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5f47-8644-4e28-bdf4-42947ed00ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:17.334023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-750d5f47-8644-4e28-bdf4-42947ed00ff4 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:17.335864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-750d5f47-8644-4e28-bdf4-42947ed00ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:17.362657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:40:17.422094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 761/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jul 13 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:21.260025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4220-ef88-46d7-a160-979bbdb07726 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:21.260859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4220-ef88-46d7-a160-979bbdb07726 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:21.260859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4220-ef88-46d7-a160-979bbdb07726 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:21.263690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 758/1519] 10.222.0.27 () {54 vars in 960 bytes} [Wed Jul 13 20:40:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:21.269077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc203-1753-4cd2-8cf5-f1c196963659 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:21.269557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc203-1753-4cd2-8cf5-f1c196963659 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:21.269661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bc203-1753-4cd2-8cf5-f1c196963659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:21.289647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-411bc203-1753-4cd2-8cf5-f1c196963659 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:21.290838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-411bc203-1753-4cd2-8cf5-f1c196963659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:21.299716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 762/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Wed Jul 13 20:40:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:21.307433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4220-ef88-46d7-a160-979bbdb07726 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:21.322614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4220-ef88-46d7-a160-979bbdb07726 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:21.328667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:21.330001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:21.330291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:21.330572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:21.340181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:21.341785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98129df-68bf-4231-8749-b3245acbe73d service placement] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:21.352389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 759/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:28.148285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c133-4979-43c0-bb4d-bd273b7847e3 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:28.148883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c133-4979-43c0-bb4d-bd273b7847e3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:28.148883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c133-4979-43c0-bb4d-bd273b7847e3 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:28.150273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:28.155450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e68aa-1af8-4afe-8803-1b2a5c29fd55 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:28.155913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e68aa-1af8-4afe-8803-1b2a5c29fd55 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:28.156029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e68aa-1af8-4afe-8803-1b2a5c29fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:28.175442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-464e68aa-1af8-4afe-8803-1b2a5c29fd55 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:28.176600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-464e68aa-1af8-4afe-8803-1b2a5c29fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:28.186067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:28.348320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c133-4979-43c0-bb4d-bd273b7847e3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:28.371003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c133-4979-43c0-bb4d-bd273b7847e3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:28.377583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:28.378228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:28.378504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:28.378772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:28.387584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:28.389180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a456-58c4-450c-9dbd-24cca782eff3 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:28.398695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 764/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:29.211732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5c31-68c3-45cb-b457-e7d0ab421f3c None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:29.212336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5c31-68c3-45cb-b457-e7d0ab421f3c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:29.212336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5c31-68c3-45cb-b457-e7d0ab421f3c None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:29.213998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 20:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:29.220061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62a16-45b6-462c-8283-78b25c5ba951 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:29.220630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62a16-45b6-462c-8283-78b25c5ba951 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:29.220735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af62a16-45b6-462c-8283-78b25c5ba951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:29.247866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9af62a16-45b6-462c-8283-78b25c5ba951 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:29.249087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9af62a16-45b6-462c-8283-78b25c5ba951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:29.259679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 20:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:29.416158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5c31-68c3-45cb-b457-e7d0ab421f3c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:29.434411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5c31-68c3-45cb-b457-e7d0ab421f3c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:29.442332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:29.443312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:29.443734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:29.444140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:29.456347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:29.458853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc830b77-5bb7-4638-beb1-02de918a0990 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:29.471299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:33.465069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:33.465663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:33.465663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:33.467001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:33.473294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fdf61-fd29-4483-9402-4b1d2e0ad514 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:33.473994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fdf61-fd29-4483-9402-4b1d2e0ad514 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:33.474150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fdf61-fd29-4483-9402-4b1d2e0ad514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:33.493565 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c37fdf61-fd29-4483-9402-4b1d2e0ad514 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:33.494750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c37fdf61-fd29-4483-9402-4b1d2e0ad514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:33.503059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:33.579533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:33.582536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:33.681861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde616d-581b-4464-aba8-b6f71d006bf5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:33.686142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:33.686819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:33.687120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:33.687382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:33.697412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:33.698955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd9ea-c80b-4c3b-9137-860899089b10 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:33.708665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 767/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:35.701630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6684-0a7f-47cc-a55a-0b061d177e81 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:35.702188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6684-0a7f-47cc-a55a-0b061d177e81 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:35.702188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6684-0a7f-47cc-a55a-0b061d177e81 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:35.703617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:35.709185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2df26-f5fd-46be-8f01-543af9b535e1 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:35.709647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2df26-f5fd-46be-8f01-543af9b535e1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:35.709764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2df26-f5fd-46be-8f01-543af9b535e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:35.729775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-35f2df26-f5fd-46be-8f01-543af9b535e1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:35.730972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-35f2df26-f5fd-46be-8f01-543af9b535e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:35.739434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:35.775278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6684-0a7f-47cc-a55a-0b061d177e81 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:35.793801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6684-0a7f-47cc-a55a-0b061d177e81 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:35.800575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:35.801554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:35.802000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:35.802432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:35.816401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:35.818585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a23b6-0f19-425d-a6f3-5e8b1bcc2597 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:35.833595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 765/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:39.463279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:39.464187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:39.464187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:39.465522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:39.471994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc99d-51cd-493d-8c4b-a42adac87f4f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:39.472837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc99d-51cd-493d-8c4b-a42adac87f4f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:39.472837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dc99d-51cd-493d-8c4b-a42adac87f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:39.480986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=81 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:40:39.494453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-784dc99d-51cd-493d-8c4b-a42adac87f4f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:39.495675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-784dc99d-51cd-493d-8c4b-a42adac87f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:39.504789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:39.806906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:39.808875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:39.883353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:40:39.897245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8edb0-14aa-44e6-a100-eb27d6d52e41 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:39.900943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:39.901590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:39.901871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:39.902144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:39.911491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:39.912985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc59b49-5229-48e1-84cb-ff2390c213a0 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:39.926574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 770/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:42.020996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:42.021554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:42.021554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:42.023016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:40:42.029306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3085b4-5e4f-429c-8047-f76250b3f60b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:42.030023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3085b4-5e4f-429c-8047-f76250b3f60b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:42.030131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3085b4-5e4f-429c-8047-f76250b3f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:42.058662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0c3085b4-5e4f-429c-8047-f76250b3f60b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:40:42.059945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0c3085b4-5e4f-429c-8047-f76250b3f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:42.068954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:40:42.379784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:40:42.382605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:40:42.397200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaaa68-1703-4e11-938d-8550a02b0093 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:40:42.401479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:40:42.402114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:40:42.402394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:40:42.402685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:40:42.412405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:40:42.414127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4ea95-9e38-4421-ae5b-ae1148837d69 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:40:42.424280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 768/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:40:52.052095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=11 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:40:52.419752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=8 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:14.662357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614019e-b14f-4486-b291-8ddcfc7944d4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.663369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614019e-b14f-4486-b291-8ddcfc7944d4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.663369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614019e-b14f-4486-b291-8ddcfc7944d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.692325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7614019e-b14f-4486-b291-8ddcfc7944d4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:14.693974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7614019e-b14f-4486-b291-8ddcfc7944d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:14.704595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 772/1540] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:14.715614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.716217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.716217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.743984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:14.745365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:14.756090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 769/1541] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:14.757032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ce04-dcae-4a3e-afe6-94ff9deffec5 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.757325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ce04-dcae-4a3e-afe6-94ff9deffec5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.757601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ce04-dcae-4a3e-afe6-94ff9deffec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.760771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:14.772489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d7fb8-ab75-475f-a9b5-a884a9af9e5f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:14.784256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:14.784945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.785232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.785515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.786259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:14.786569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:14.787783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:14.787783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:42:14.787783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:42:14.788687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:14.791963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-21f7ce04-dcae-4a3e-afe6-94ff9deffec5 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:14.793179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-21f7ce04-dcae-4a3e-afe6-94ff9deffec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:14.811815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 770/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:42:14.814998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 773/1543] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:14.820311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:14.824824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.825112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.825389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.831406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b803-5e8d-4885-917e-86a0cf9a9d66 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:14.841807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:14.842491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.842779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.843093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.844440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:14.846017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83628630-9511-4946-82ae-7c9cdfed3e27 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:14.866295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:14.867665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:14.886561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 774/1544] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:14.891651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:14.903987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059d740-9d5b-46c2-9d3b-ef9c2ef3e917 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:14.906026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 771/1545] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:14.907304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:14.907602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:14.907884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:14.939661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:14.940910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.020000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.022205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.022733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.023227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.024180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.024966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.026838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479f1ac-1498-49ee-93cf-27118fbb554b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.039917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 772/1546] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.039917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.044874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 775/1547] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.046530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133a86-4b79-4e10-b76a-745725be1323 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.047070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133a86-4b79-4e10-b76a-745725be1323 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.047447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd038-aa1f-4025-9424-dd8143db2160 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.047771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133a86-4b79-4e10-b76a-745725be1323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.052382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.053394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.053979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.054471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.055474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.056720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:15.056720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:42:15.056720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:42:15.058330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d4a4-c18f-47a3-b476-572c2c63a9ca admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.081181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e1133a86-4b79-4e10-b76a-745725be1323 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.082727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e1133a86-4b79-4e10-b76a-745725be1323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.085374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 773/1548] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.090304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.090608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.090888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.099937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 776/1549] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.101881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d355-0672-4e40-be21-76ce45aec7f4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.102236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d355-0672-4e40-be21-76ce45aec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.102587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222d355-0672-4e40-be21-76ce45aec7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.113514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.114734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.120819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-3222d355-0672-4e40-be21-76ce45aec7f4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.121995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3222d355-0672-4e40-be21-76ce45aec7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.123644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 774/1550] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.124478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.131302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 777/1551] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.132628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db695c2-d166-4c4b-8b6e-bfc740393397 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.132882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db695c2-d166-4c4b-8b6e-bfc740393397 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.133178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db695c2-d166-4c4b-8b6e-bfc740393397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.141365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fede5d-fead-4a8d-98f5-83ad5b9cf4db None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.146014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.146698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.147051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.147418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.148140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.150090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.152213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-4db695c2-d166-4c4b-8b6e-bfc740393397 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.153581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4db695c2-d166-4c4b-8b6e-bfc740393397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.162900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 778/1552] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.164138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367e07-5ca5-48fe-90b4-c28f0f9e1313 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.164420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367e07-5ca5-48fe-90b4-c28f0f9e1313 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.164717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367e07-5ca5-48fe-90b4-c28f0f9e1313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.181614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 775/1553] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.182409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.183046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5a367e07-5ca5-48fe-90b4-c28f0f9e1313 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.184225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5a367e07-5ca5-48fe-90b4-c28f0f9e1313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.243988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 779/1554] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.245189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1aad-c3cb-4fce-8e62-266368b6a721 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.245475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1aad-c3cb-4fce-8e62-266368b6a721 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.245748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1aad-c3cb-4fce-8e62-266368b6a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.246569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b25de-3c0e-4eb1-9293-825f4ec3e57b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.255392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.256110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.256386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.256678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.257396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.259087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fbdc5-57ec-4ab0-92d1-0d6ede415d41 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.263791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-212a1aad-c3cb-4fce-8e62-266368b6a721 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.264662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:15.265023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-212a1aad-c3cb-4fce-8e62-266368b6a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.271415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 776/1555] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:15.273136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3075-afab-4f6a-9662-f2cb399c692c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.273136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3075-afab-4f6a-9662-f2cb399c692c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.273579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3075-afab-4f6a-9662-f2cb399c692c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.274182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 780/1556] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.275446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.275728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.276001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.291846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f47c3075-afab-4f6a-9662-f2cb399c692c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.293052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f47c3075-afab-4f6a-9662-f2cb399c692c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.293629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.294776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.301363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 777/1557] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.305745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 781/1558] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.305914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.305914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.305914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.306162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.315346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5e5ae-b8c4-4da2-bb7a-733dd09a3db0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.319971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.320324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.320618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.320899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.321171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.321502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.321889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.322191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.323811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab95e8-0937-4e53-aa0a-b0de233ebe17 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.330666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 778/1559] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.331518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.340036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 782/1560] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.347201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c3c49-2f3b-4d7b-8ce5-6ec15e3f7e52 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.347289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.347289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.347289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.347532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.347532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.347532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.347532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.347825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.349442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daca1c-5edb-446a-9b11-407d5a48d12c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.360302 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.361972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.370741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 783/1561] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.371556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.376444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 779/1562] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.376444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.376444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.376444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.381195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9276e6-ea58-47dc-a352-0c1806b831b3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.386047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.386704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.387030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.387307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.388055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.389731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.395362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.396913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.399803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 784/1563] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:15.400583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.408898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 780/1564] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:15.409726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.414151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2a5c-6e14-4574-8a0a-01bf8dc3742f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.419526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.420191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.420474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.420751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.421503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.421822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.422091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c058d3-c52b-4970-aadf-f1190c2d3a3b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.423619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.427953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.428655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.428970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.429250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.430141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.430502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.431389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:15.432984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.437745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 785/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.438543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.448577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d181-befe-41be-9154-95ffbad0300e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.451334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 781/1566] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.452111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.457075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.458305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.458305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.458545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.459513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.459795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.461536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.462344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba2c15-0de9-4581-b201-4fd4e6331268 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.467428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.468072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.468360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.468642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.469325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.471267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.473590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 786/1567] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.474580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.486729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5bbc-621d-4260-9687-754149c252e8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.493240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.493978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.494300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.494509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.495289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.495592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.497191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.503454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 782/1568] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.503454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.510103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 787/1569] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.510877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.524738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d4143-03ca-4ea9-87b5-c19adcb56d55 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.563973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1862a-d037-4748-aae0-3e579b760722 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.568643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.569313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.569598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.569873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.570599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.572250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.580933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.581830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.582108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.582376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] PATH_INFO: `/v3/projects/3ba511555e4544568aa95bcb7dc0b6b0/users/5b3226652f424f078af61ef74167fff1/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.582477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 783/1570] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:15.583267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.594112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17105080-0f0c-4cd5-b811-1b803bbf4a0c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.597332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba511555e4544568aa95bcb7dc0b6b0, user_id=5b3226652f424f078af61ef74167fff1, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.598362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:15.598362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:42:15.598362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:42:15.598836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.600149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.600397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.600511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.600711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.601436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:15.601743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.603377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.613853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 788/1571] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:15 2022] PUT /identity/v3/projects/3ba511555e4544568aa95bcb7dc0b6b0/users/5b3226652f424f078af61ef74167fff1/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:15.614774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.618249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 784/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:15.619120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.633908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6fd42-c2ba-47f9-a875-cd3fff823f03 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.685475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bbb0b-f8f5-4131-937e-c9b47aa02da4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.690039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.690704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.691007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.691279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.691513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.691969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.692177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.692465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.692744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.693010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:15.693010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:42:15.693010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:42:15.693600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.694206 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.695554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.709288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:15.725933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 789/1573] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.725933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.726192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 785/1574] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.726845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.770523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:15.790229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf618a6-752a-4269-8eb1-42e58417ad5a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.792583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bced-5a5e-466b-81f2-0fa5c4bc755e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.795167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.795843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.796123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.796392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.797075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.797275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.797937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.798218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.798519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.799026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.799374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.801284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.822462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 786/1575] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.823295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.832675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 790/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.832675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.833146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaedae-4e4a-4772-b558-8efe4a3a514b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.891138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22578d2-faa9-479e-b9c7-0689fe86ccad admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.892266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.892935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.893216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.893491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.894173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.895733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.896353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.896464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.896695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.896973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.897702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.899336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbfe72-658e-4de4-8e18-0cadc0523f0a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:15.909128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 791/1577] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:15.911265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.911560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.912713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.922850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 787/1578] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:15.923878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:15.940040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] MFA Rules not processed for user `5b3226652f424f078af61ef74167fff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:15.941241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:15.991216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b583e6-150f-4a23-9a1e-fdf3e6b2f3fe admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:15.995692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:15.996343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:15.996626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:15.996896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:15.997568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:15.999498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.004393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 792/1579] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:16.005282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.015842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cd2c-70d4-48b9-af15-b713ea73adec None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.016484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.021617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.022458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.022747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.023062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.024061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.026483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.034621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 788/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:15 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.039129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.050568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 793/1581] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.051490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.061563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813b8a-3baa-4358-a977-d3a7d4452cc5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.091058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.108175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727477e-1a8e-4ccb-8062-c8871cdac131 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.112810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.113501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.113783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.114072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.114760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.116855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.126878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.127600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.127878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.128176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.129314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.131603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.138960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 789/1582] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.139868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.144927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 794/1583] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.145939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.150558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a94e0-6b6e-4b7d-be0d-b32289cc433d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.156398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.157217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.157502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.157777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.158052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dafa9-be60-45fd-bf41-920e65c2d557 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.158501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.160481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.162686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.163738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.164020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.164293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] PATH_INFO: `/v3/projects/ea62df9ad2df4e4aa023bc6daf811863/users/f1fbd61979b9407bb01e75e7cbd9346d/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.180238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea62df9ad2df4e4aa023bc6daf811863, user_id=f1fbd61979b9407bb01e75e7cbd9346d, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.184294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8cee9-0c62-46c0-8f70-07c08541e72c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.188080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 790/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 302 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.188996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.197008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 795/1585] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/ea62df9ad2df4e4aa023bc6daf811863/users/f1fbd61979b9407bb01e75e7cbd9346d/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:16.208064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efc244-da2f-4a58-a773-7ab9645d3171 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.208064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efc244-da2f-4a58-a773-7ab9645d3171 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.208064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efc244-da2f-4a58-a773-7ab9645d3171 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.208336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9fa5a-7f17-4ff8-b73c-e228930cc52a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.208464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 796/1586] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 13 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:16.208464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efc244-da2f-4a58-a773-7ab9645d3171 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.262689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.263522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.263894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.264085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.264856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.267074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.268571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efc244-da2f-4a58-a773-7ab9645d3171 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.273628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.274263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.274551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.274830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.275560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.277488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.288231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 791/1587] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.290069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.298113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 797/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.299029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.301999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f5b11-9d22-4b9d-a531-32cf8f3689ea admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.308604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.309293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.309419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99139995-668d-43cc-b9da-875e7d219616 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.309572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.309843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.310591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.312238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.313983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.314628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.314927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.315215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.316064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.317615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.325667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 792/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.325667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.327856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 798/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.331458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.333454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcd581-6d9f-40e3-9b28-ef585b62dda0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.339627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.340278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.340580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.340836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.341552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.341664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111839f-906b-47f9-a26d-9cc3d93333c1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.343188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675a805-9e7e-453c-83d1-4e6c0d0250a4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.346391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.347077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.347360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.347634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.348698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.350999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be63b79-bc5e-40f7-8ccf-6bf5e019b4e6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.354040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.355299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.355587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.355862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.363946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 799/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.365799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca59388-ba45-437b-8198-819f61fd17da None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.365958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca59388-ba45-437b-8198-819f61fd17da None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.366149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca59388-ba45-437b-8198-819f61fd17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.392974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-cca59388-ba45-437b-8198-819f61fd17da None None] MFA Rules not processed for user `f1fbd61979b9407bb01e75e7cbd9346d`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:16.394193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cca59388-ba45-437b-8198-819f61fd17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:16.394560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:16.395778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:16.412667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.461703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 800/1593] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:16.462622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca59388-ba45-437b-8198-819f61fd17da None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.464649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 794/1594] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:16.465729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.468262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.474584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca59388-ba45-437b-8198-819f61fd17da None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.477425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108482-39f6-4e39-ab03-99ba9528efea None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.480950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.481615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.481893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.482161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.482502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.482884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.483192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.483497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.483775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.484496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.484594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.486087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.495306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 801/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.496132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.496934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 795/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.497830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.508036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db77e-aa7f-41fc-8a93-4dd8ce817261 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.511092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e7243-3a2b-4682-9313-617ce8639eaf admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.512868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.513619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.513893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.514174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.514928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.516285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.516531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.517099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.517380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.517728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.518721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.520005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.526768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 796/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.527522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.534201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 802/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.535198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.536760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ddd90-bd8c-4083-ac9d-4e3faebee0f5 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.541336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.542244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.542526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.542801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] PATH_INFO: `/v3/projects/c3c271d8fb604693be9a295ca44f6e9b/users/45c80d80bae843b3abdfdfb1d54ca205/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.545376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5c99-461b-4fcd-9a0e-3fdb3a8a40dd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.550085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.550794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.551112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.551398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.552118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.553755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.557627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c271d8fb604693be9a295ca44f6e9b, user_id=45c80d80bae843b3abdfdfb1d54ca205, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.560322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.564371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 803/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.565144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.574867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156fa2-7c5c-4376-aaf0-cf5264a1d8fe admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.575896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 797/1600] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/c3c271d8fb604693be9a295ca44f6e9b/users/45c80d80bae843b3abdfdfb1d54ca205/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:16.576693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.636317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.636986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.637271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.637547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.638267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.640222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.648382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c168c-3665-4cab-9f20-8c2d05ba405a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.653954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.654804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.655259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.655728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.669681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 804/1601] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.670544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.719487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.721109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.730292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 798/1602] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:16.731129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.733690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b017bd1-55fe-4b7f-b168-4b1d17606b08 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.737859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.739897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.740583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.740874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.741136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.741907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.743513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.744253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaefdd-94a4-4f90-89d2-2d1757fad0ef service nova] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.752161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.752945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.753322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.753825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 805/1603] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.753944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.754441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.754690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.756729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.764272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea5f9-5fe8-4df7-86a5-19f9af19cdc2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.768886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.769037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 799/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:16.769930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.770104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.770340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.770683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] PATH_INFO: `/v3/projects/4d01ade2b091447296e58eae444f32f9/users/be0580895be5441d8503d584b33fa954/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.782266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aea12-aa8e-4ebf-824d-c4e0433d951b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.786469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d01ade2b091447296e58eae444f32f9, user_id=be0580895be5441d8503d584b33fa954, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.788316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.789314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.789440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.789777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.790186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] PATH_INFO: `/v3/projects/c5e207ce011f4d27801b82f81c7c2162/users/c26c047c73a748cda14345a2ca3aa319/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.806352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 806/1605] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/4d01ade2b091447296e58eae444f32f9/users/be0580895be5441d8503d584b33fa954/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:16.806908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e207ce011f4d27801b82f81c7c2162, user_id=c26c047c73a748cda14345a2ca3aa319, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.807167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.809937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93cab-0b6d-4a46-a34c-b68f98a962f1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.824768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 800/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/c5e207ce011f4d27801b82f81c7c2162/users/c26c047c73a748cda14345a2ca3aa319/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:16.829419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.829670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.829970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.845486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:16.848170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:16.849533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:16.881972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd99888-aa26-4de1-a2a5-549d6bdffbb8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.913552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 801/1607] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:16.914406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.932037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1374a7f-f884-4a3e-b50c-932ef8643463 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.936969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.937630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.937908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.938180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.938869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.940831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.941786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:16.943047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:16.943416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:16.943781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] PATH_INFO: `/v3/projects/0cfb69bedef145d8a85db2787ce53fe8/users/afe60bc7199a4d0692506480ccc534de/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:16.960660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfb69bedef145d8a85db2787ce53fe8, user_id=afe60bc7199a4d0692506480ccc534de, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:16.963929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 802/1608] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:16 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:16.964638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:16.964944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:16.975727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b9caa-2433-4e05-bc36-aa54f486ae74 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:16.979631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 807/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/0cfb69bedef145d8a85db2787ce53fe8/users/afe60bc7199a4d0692506480ccc534de/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:16.980793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.030161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.031179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.031522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.031822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] PATH_INFO: `/v3/projects/5ad2372a6fb340a9a2f7ae39729ae2bc/users/1c3ea52f5b344fa1bd3688d963700473/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.045181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f29b-20df-4600-a64d-59cf7f3f07e3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.046176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad2372a6fb340a9a2f7ae39729ae2bc, user_id=1c3ea52f5b344fa1bd3688d963700473, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.049108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64edcb-233b-4b2b-bfd2-ac635d6812d5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.049872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.050833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.051152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.051592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] PATH_INFO: `/v3/projects/40567f16e35e4007a5349516ea746e40/users/0e69fea1eeb5453aa4b09799894b1e7c/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.063679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 803/1610] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/5ad2372a6fb340a9a2f7ae39729ae2bc/users/1c3ea52f5b344fa1bd3688d963700473/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:17.065028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038291e-c088-4ba3-818e-32841d21887c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.065319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038291e-c088-4ba3-818e-32841d21887c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.065595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038291e-c088-4ba3-818e-32841d21887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.076388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40567f16e35e4007a5349516ea746e40, user_id=0e69fea1eeb5453aa4b09799894b1e7c, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.079393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720d33-a049-4636-8853-477942622b42 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.084204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a038291e-c088-4ba3-818e-32841d21887c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.085515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a038291e-c088-4ba3-818e-32841d21887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.093842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 808/1611] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:16 2022] PUT /identity/v3/projects/40567f16e35e4007a5349516ea746e40/users/0e69fea1eeb5453aa4b09799894b1e7c/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:17.095194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.095548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.095887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.112447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.113630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.117439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:17.152940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:17.154096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 804/1612] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.155694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038291e-c088-4ba3-818e-32841d21887c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.182523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 809/1613] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.183639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.194488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91156-8416-401c-b863-6bc0f65cdefa None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.199116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.199783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.200063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.200335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.201074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.202711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613369c3-2dbc-4817-b03b-22b072df60d7 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.216514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 810/1614] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:17.216514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32f40-6de0-4f6c-ada1-ed97ea530797 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.216514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32f40-6de0-4f6c-ada1-ed97ea530797 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.216514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32f40-6de0-4f6c-ada1-ed97ea530797 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.217215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 811/1615] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 13 20:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:17.217610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec5ab-275e-4bd4-a169-c773db479fda None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.217910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec5ab-275e-4bd4-a169-c773db479fda None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.218184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec5ab-275e-4bd4-a169-c773db479fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.219809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038291e-c088-4ba3-818e-32841d21887c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.223763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.224651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.225368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.225652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.235332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.236924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f4ce-acc1-4fac-8490-87eab24b8355 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.245457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8f5ec5ab-275e-4bd4-a169-c773db479fda None None] MFA Rules not processed for user `afe60bc7199a4d0692506480ccc534de`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.246837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8f5ec5ab-275e-4bd4-a169-c773db479fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.252362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 805/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:17.253748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.254042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.254322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.283541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] MFA Rules not processed for user `1c3ea52f5b344fa1bd3688d963700473`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.284749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.328465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 812/1617] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.330049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.330340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.330622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.354672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.355820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.367972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 806/1618] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.367972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.368269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 813/1619] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.368269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.368269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.369807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.381680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddfa81-90a7-411e-9686-e41e3626bbb9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.382800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5242955-d140-42c1-8b95-f6d82ff8c431 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.386541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.386777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.387380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.387507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.387733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.387841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.388010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.388230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.399122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.399326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.400642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fe6a5-6f5d-4f16-aae0-4d7437652b83 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.400855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.411600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 807/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:17.412921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 814/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:17.413068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.414381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.414758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.415077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.424756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b6184-1d6b-4e02-b6bb-30bc9384b342 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.430484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.431877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.432314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.432709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] PATH_INFO: `/v3/projects/152db635f336406bb335738726d5cfd1/users/913abf964936423a9b855cd6c236754b/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.436600 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:17.437640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:17.465529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152db635f336406bb335738726d5cfd1, user_id=913abf964936423a9b855cd6c236754b, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.468679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.489291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 808/1622] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:17 2022] PUT /identity/v3/projects/152db635f336406bb335738726d5cfd1/users/913abf964936423a9b855cd6c236754b/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:17.490586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.535723 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:17.575836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 815/1623] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:17.582483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.583965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d0335-a87b-4eab-b843-e25ba1ab2df0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.592310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.593140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.593533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.593945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.595217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.598707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.602004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61e96-df1d-403f-bb41-d94a78b307a0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.608231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.609095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.609913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.610786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.611272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.614071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.633406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 809/1624] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:17.634337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.674880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 816/1625] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:17.676263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.692018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:17.711966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ead54-0627-4bb9-9831-a18bf7c10dd8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.763253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601ccc-2a9f-4068-9235-6dd081e9d0db admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.775645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.777144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.777144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.777144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.781020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.781900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.782041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.782242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.783028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.787692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.790828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.792985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.803399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 817/1626] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:17.803965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.808261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 810/1627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:17.809310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.820084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472c47-1888-45bd-9fa7-32fcd80774c1 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.825473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.826264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.826677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.827250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.828090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.830511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.869176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 811/1628] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/users => generated 308 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:17.870202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.894436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9f1-5474-4b76-99e6-80c85e5b799a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.898498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288835-5896-473d-888a-d08c34b355b1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.903637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.904395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.904719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.905092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.907423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.908437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.908763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.909375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.912182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.921778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:17.947353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 812/1629] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:17 2022] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:17.949235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:17.963857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71751-213d-41ef-8466-1693c4f31749 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:17.972014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:17.973038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:17.973374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:17.973866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] PATH_INFO: `/v3/projects/152db635f336406bb335738726d5cfd1/users/913abf964936423a9b855cd6c236754b/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:17.984831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=152db635f336406bb335738726d5cfd1, user_id=913abf964936423a9b855cd6c236754b, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:17.991002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.021503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 813/1630] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:17 2022] PUT /identity/v3/projects/152db635f336406bb335738726d5cfd1/users/913abf964936423a9b855cd6c236754b/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:18.023220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.044099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.046233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.064334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 818/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:18.065292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.078752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd79ec-755d-4093-9bfa-1c27869ae550 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.144855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:18.160925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:18.170320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.171031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.172006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.174692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.175579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.177783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dabf80-6277-4550-b9ef-78aeec95c9a4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.192812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 819/1632] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:18.197471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.197760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.198040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.207574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177edeeb-1370-4af1-804e-90ddc7eca3fe admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.214820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.215862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.216345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.216799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.217909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.220113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.232400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] MFA Rules not processed for user `913abf964936423a9b855cd6c236754b`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:18.233842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:18.235799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 814/1633] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:18.237197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.253932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbe7c3-2379-4a6f-b3fa-d4f07cad6a83 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.260710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.261843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.262191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.262674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] PATH_INFO: `/v3/projects/f440924ea2f64ce79e6a3248d99c43ac/users/090f2612241b464e9409d98ebf5ae567/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.285745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f440924ea2f64ce79e6a3248d99c43ac, user_id=090f2612241b464e9409d98ebf5ae567, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.290019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.313587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 815/1634] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:18 2022] PUT /identity/v3/projects/f440924ea2f64ce79e6a3248d99c43ac/users/090f2612241b464e9409d98ebf5ae567/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:18.314583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.356231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 820/1635] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:18.356952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.389254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b9e90-855b-48a1-937b-789512c3e238 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.394103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0da1-4fc6-4c0b-a077-3c9d4b1330ec None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.394766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.396014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.396627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.397005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] PATH_INFO: `/v3/projects/cbeab20274fc41029e76a196fb4b7d0b/users/2f9c44e7982a4f538441af98be7f8706/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.405532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.406299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.406643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.406942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.408241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.411380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.415037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeab20274fc41029e76a196fb4b7d0b, user_id=2f9c44e7982a4f538441af98be7f8706, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.418750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.430440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 821/1636] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:18.431616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.448677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 816/1637] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:18 2022] PUT /identity/v3/projects/cbeab20274fc41029e76a196fb4b7d0b/users/2f9c44e7982a4f538441af98be7f8706/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:18.449777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.529208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13918625-ec51-4642-a231-c1304c0ba3b0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.573525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0eca33-0815-4038-bc95-9598abcac7f0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.602829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.605303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.606086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.606382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] PATH_INFO: `/v3/projects/f440924ea2f64ce79e6a3248d99c43ac/users/090f2612241b464e9409d98ebf5ae567/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.613852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f440924ea2f64ce79e6a3248d99c43ac, user_id=090f2612241b464e9409d98ebf5ae567, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.621672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.644354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.645103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.645453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.645801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.662094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 817/1638] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:18 2022] PUT /identity/v3/projects/f440924ea2f64ce79e6a3248d99c43ac/users/090f2612241b464e9409d98ebf5ae567/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:18.662094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.691346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:18.724865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:18.788797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56bd3-ae15-478a-bacf-75027ee158b9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.800333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.802011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.803983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.805430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.807140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.808343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.809833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.813692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e02b13-3204-47ea-ad71-470e95b4e2dc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.835608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 818/1639] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:18.837381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.837894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.838715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.839249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 822/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:18.840514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:18.864060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48781761-5951-4b81-b097-9a32b747abbc service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:18.875533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] MFA Rules not processed for user `090f2612241b464e9409d98ebf5ae567`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:18.876277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:18.877241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:18.877376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.877803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.877938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] PATH_INFO: `/v3/projects/cbeab20274fc41029e76a196fb4b7d0b/users/2f9c44e7982a4f538441af98be7f8706/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.883863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeab20274fc41029e76a196fb4b7d0b, user_id=2f9c44e7982a4f538441af98be7f8706, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:18.891569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076928-b7fc-4fed-a9d5-b8f696ddb3a6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:18.927397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 823/1641] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:18 2022] PUT /identity/v3/projects/cbeab20274fc41029e76a196fb4b7d0b/users/2f9c44e7982a4f538441af98be7f8706/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:18.929896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f977e3-e7cd-4784-bd9f-9d2b67ee57e9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:18.930193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f977e3-e7cd-4784-bd9f-9d2b67ee57e9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:18.930472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f977e3-e7cd-4784-bd9f-9d2b67ee57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:18.985913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b7f977e3-e7cd-4784-bd9f-9d2b67ee57e9 None None] MFA Rules not processed for user `2f9c44e7982a4f538441af98be7f8706`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:18.987186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b7f977e3-e7cd-4784-bd9f-9d2b67ee57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:19.012982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 819/1642] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:19.023484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:19.138344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c315bd-f37a-4794-b2e8-13e11b62ca05 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:19.140917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 824/1643] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:19.287888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:19.289354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.290274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.291157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.307243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:19.375891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03018-7721-473b-babb-fd69e7760bbb None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.376400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03018-7721-473b-babb-fd69e7760bbb None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.376828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03018-7721-473b-babb-fd69e7760bbb None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.378860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 825/1644] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 13 20:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:19.391511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69bacc-dbac-44ef-b3cd-77a1b5669d20 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.392208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69bacc-dbac-44ef-b3cd-77a1b5669d20 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.392674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69bacc-dbac-44ef-b3cd-77a1b5669d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.423279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8a69bacc-dbac-44ef-b3cd-77a1b5669d20 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:19.425650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8a69bacc-dbac-44ef-b3cd-77a1b5669d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:19.470002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:19.475808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:19.510906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 820/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:19.567278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:19.578730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40475b1-03fc-4692-abc2-6cea1d1c1c8e service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:19.583057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:19.583962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.584286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.584521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.585775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 826/1646] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 13 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:19.590003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566ffa-f6a6-47c1-8804-6862b49ac310 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.590317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566ffa-f6a6-47c1-8804-6862b49ac310 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.591452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566ffa-f6a6-47c1-8804-6862b49ac310 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.594841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 827/1647] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 13 20:42:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:19.597872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:19.601069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:19.604266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.604559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.604881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.616405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 821/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:42:19.625760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:19.627241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:19.645409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 828/1649] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:19.804872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:19.823276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35d59-c27d-4adf-b11a-f8d0d3506117 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:19.835163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:19.838028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.839574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.840466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:19.898337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:19.904170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:19.945009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 822/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:19.946788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:19.967461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0adf6-e7ee-4a9c-8425-d2c8f3064a55 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:19.971460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:19.971915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:19.972200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:19.972474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:20.020941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:20.095238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:20.096828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e816f-9f16-40be-b53b-d262f3e7b818 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:20.120838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 829/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:20.428991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:20.584357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dfba6-d913-4114-875d-8fbeba3fb82f service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:20.591645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:20.592726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:20.593104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:20.593475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] PATH_INFO: `/v3/users/afe60bc7199a4d0692506480ccc534de` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:20.595055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe60bc7199a4d0692506480ccc534de)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:20.597033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:20.691511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe60bc7199a4d0692506480ccc534de'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:20.692675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe60bc7199a4d0692506480ccc534de'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:20.708806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe60bc7199a4d0692506480ccc534de'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:20.710009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe60bc7199a4d0692506480ccc534de'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:20.727550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe60bc7199a4d0692506480ccc534de'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:20.732255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:20.747612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 823/1652] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:20 2022] DELETE /identity/v3/users/afe60bc7199a4d0692506480ccc534de => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:20.753973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cce2-a253-4a70-85bd-964616413083 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:20.764418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cce2-a253-4a70-85bd-964616413083 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:20.764776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924cce2-a253-4a70-85bd-964616413083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:20.798742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f924cce2-a253-4a70-85bd-964616413083 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:20.800668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f924cce2-a253-4a70-85bd-964616413083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:20.916917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 830/1653] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:20.932743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:20.935911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:21.063890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91d357-44ab-420e-a72a-569e41cfc52b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:21.078639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:21.079483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:21.079675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:21.079908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:21.102381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:21.104135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:21.131592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 824/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:42:22.158394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924cce2-a253-4a70-85bd-964616413083 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:22.160299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f924cce2-a253-4a70-85bd-964616413083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:22.186172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924cce2-a253-4a70-85bd-964616413083 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:22.194749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:22.196134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:22.198033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:22.198413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] PATH_INFO: `/v3/projects/0cfb69bedef145d8a85db2787ce53fe8` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:22.208681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfb69bedef145d8a85db2787ce53fe8)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:22.211809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:22.303866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfb69bedef145d8a85db2787ce53fe8', 'request_id': 'req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.319815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfb69bedef145d8a85db2787ce53fe8', 'request_id': 'req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.345775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfb69bedef145d8a85db2787ce53fe8', 'request_id': 'req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.398420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] The token cache is being invalidate because project 0cfb69bedef145d8a85db2787ce53fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:22.399025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.402514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.405585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 831/1655] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:22 2022] DELETE /identity/v3/projects/0cfb69bedef145d8a85db2787ce53fe8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:22.409921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:22.432455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a0d7a-bcf3-4c15-8c8e-f023555445db service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:22.608829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:22.609923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:22.610351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:22.610821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] PATH_INFO: `/v3/users/2f9c44e7982a4f538441af98be7f8706` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:22.612923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9c44e7982a4f538441af98be7f8706)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:22.623956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:22.735153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:22.737290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:22.742040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9c44e7982a4f538441af98be7f8706'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.744472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9c44e7982a4f538441af98be7f8706'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.755727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9c44e7982a4f538441af98be7f8706'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.756600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9c44e7982a4f538441af98be7f8706'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.788985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9c44e7982a4f538441af98be7f8706'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:22.811622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 825/1656] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:22 2022] DELETE /identity/v3/users/2f9c44e7982a4f538441af98be7f8706 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:22.832524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:22.855609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfbcd0-1195-442e-9900-2e4c38ca2cb4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:23.000662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:23.001490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:23.002147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:23.002724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:23.005034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:23.162672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:23.167717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:23.195624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 832/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:42:24.018135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:24.019699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.071612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:24.120003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:24.122814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.146423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7669-b29d-4de4-be29-6d3c6162f1bc admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:24.154261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:24.155032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.155371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.156357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] PATH_INFO: `/v3/users/5b3226652f424f078af61ef74167fff1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.158410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3226652f424f078af61ef74167fff1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:24.160918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:24.181883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5602-ac6f-4a50-ba52-352b901cfbf6 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:24.210629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:24.214375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.216172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.218716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] PATH_INFO: `/v3/projects/cbeab20274fc41029e76a196fb4b7d0b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.222780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbeab20274fc41029e76a196fb4b7d0b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:24.231730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:24.298178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3226652f424f078af61ef74167fff1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.299156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3226652f424f078af61ef74167fff1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.337699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3226652f424f078af61ef74167fff1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.339097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3226652f424f078af61ef74167fff1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.372947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-620f8995-d4bd-4f9b-9d2f-35f5210d6dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3226652f424f078af61ef74167fff1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.413041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 826/1658] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:24 2022] DELETE /identity/v3/users/5b3226652f424f078af61ef74167fff1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:24.414827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.417239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.417691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.442611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbeab20274fc41029e76a196fb4b7d0b', 'request_id': 'req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.465057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:24.465803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbeab20274fc41029e76a196fb4b7d0b', 'request_id': 'req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.466316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.482104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbeab20274fc41029e76a196fb4b7d0b', 'request_id': 'req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.517312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] The token cache is being invalidate because project cbeab20274fc41029e76a196fb4b7d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:24.517616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.518447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d93a37a8-0a39-4ea2-b2ec-50ee53925a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:24.531360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 833/1659] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:24 2022] DELETE /identity/v3/projects/cbeab20274fc41029e76a196fb4b7d0b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:24.532947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2802-3724-4f25-835f-5002a06536b0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.534113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2802-3724-4f25-835f-5002a06536b0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.534401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2802-3724-4f25-835f-5002a06536b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.579015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-bd2f2802-3724-4f25-835f-5002a06536b0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:24.582754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bd2f2802-3724-4f25-835f-5002a06536b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.675278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 827/1660] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:24.714057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:24.722752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:24.724313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.795796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 834/1661] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:24.797437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.797730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.798019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.822750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:24.824189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:24.841794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 835/1662] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:24.842858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:24.857246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:24.880141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f160f80-1de4-45d3-b762-c416b33bb02f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:24.895281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:24.896347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.896632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.896918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.897665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:24.897974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:24.899632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:24.904588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64bac-38e6-4613-84f8-954c8c8eb862 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:24.909146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:24.909492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:24.909786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:24.910069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:24.932508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:24.935166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:24.937454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 836/1663] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:24.938379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:24.961928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 828/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:24.973728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905b5a-7920-438a-b80b-3ff67d8853d4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:24.994403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:24.995162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.001956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.002334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.003215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:25.005208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:25.073031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 837/1665] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:24 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:25.077289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:25.090037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb5ef-23dc-48b7-81e5-200995fcb985 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:25.267184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:25.267649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.267931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.268205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.268915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:25.282975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:25.363160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 829/1666] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:25 2022] POST /identity/v3/users => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:25.368306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:25.389018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7753b-c0dc-425c-84b0-fdce33ac3c7c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:25.407643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:25.409805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.417391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.417595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.418430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:25.420496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:25.444795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 838/1667] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:25.449098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:25.465765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f3596-653e-4194-8c42-2ae5c31b4e51 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:25.483653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:25.484356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.484638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.484912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.485655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:25.487339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f94d-34fc-4899-b31b-548db8d4b9f2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:25.523788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:25.530682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 830/1668] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:25.540501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac5ab0-b5bb-4706-8f99-b07287ebac1b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:25.553199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:25.554227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.554524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.554831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] PATH_INFO: `/v3/projects/f9da446f4b3b4db59b1ce782ec77b330/users/351cf9e695324a38afd389705402feb0/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.592472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9da446f4b3b4db59b1ce782ec77b330, user_id=351cf9e695324a38afd389705402feb0, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:25.595201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:25.631766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 839/1669] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:25 2022] PUT /identity/v3/projects/f9da446f4b3b4db59b1ce782ec77b330/users/351cf9e695324a38afd389705402feb0/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:25.636221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:25.636517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:25.636798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:25.700814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:25.703970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:25.873354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 831/1670] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:25.918550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:26.036235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba124b9-0edf-4a2a-8795-44b052cbf2c3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:26.054999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:26.055665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:26.055956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:26.056239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:26.095261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:26.096725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0896cc-81eb-48da-826d-dd337f3f1762 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:26.123742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 840/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:27.439477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:27.441711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:27.480348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533235c-1fba-4005-be84-f92ebe1d790f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:27.485921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:27.486976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:27.487388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:27.487789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] PATH_INFO: `/v3/projects/3ba511555e4544568aa95bcb7dc0b6b0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:27.492092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba511555e4544568aa95bcb7dc0b6b0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:27.493382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: WARNING py.warnings [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:27.493382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: warnings.warn(msg) Jul 13 20:42:27.493382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: Jul 13 20:42:27.494941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:27.694565 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba511555e4544568aa95bcb7dc0b6b0', 'request_id': 'req-2131b151-d6fc-40bb-a74b-50dba751f61c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:27.699983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:27.708492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba511555e4544568aa95bcb7dc0b6b0', 'request_id': 'req-2131b151-d6fc-40bb-a74b-50dba751f61c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:27.728348 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba511555e4544568aa95bcb7dc0b6b0', 'request_id': 'req-2131b151-d6fc-40bb-a74b-50dba751f61c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:27.763573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] The token cache is being invalidate because project 3ba511555e4544568aa95bcb7dc0b6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:27.764177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:27.765059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2131b151-d6fc-40bb-a74b-50dba751f61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:27.767627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 832/1672] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:27 2022] DELETE /identity/v3/projects/3ba511555e4544568aa95bcb7dc0b6b0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:27.772498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:27.773000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:27.773000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:27.811353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:27.814466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:27.928183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:27.928634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:27.929038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:27.932223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 841/1673] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:27.982019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:27.984735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:28.018801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 833/1674] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:28.021035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.030594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:28.057340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1894914-378d-4b0c-a45c-7f30c558cbc8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.091486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.092190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.092475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.092752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.093661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:28.093973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.095644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.122485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 842/1675] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:28.127515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.140999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c8e96-2a43-4ded-bb21-29375bd27fd1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.151586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.152734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.154359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.155197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.156160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.166605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.265424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 834/1676] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:28 2022] POST /identity/v3/projects => generated 353 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:28.268206 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.284976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c344f-09c2-40a1-90fd-ca3988f15ce4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.507411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.508470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.509038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.510466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.512878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.515272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.591534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 843/1677] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:28 2022] POST /identity/v3/users => generated 277 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:28.595319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.612874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a244-f56d-478a-a26d-cd814245657b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.629045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.629762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.630046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.630549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.631482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.633804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.664021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 835/1678] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:28.664397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.723634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf4310-3813-470d-ab11-f81c7b3f2e52 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.743697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.744518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.745404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.745404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.745838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.749450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8521-8086-443d-8842-98b915049d1d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.778266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 844/1679] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:28.782353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:28.796040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341ebe-5a3d-4eb6-afd9-91f2965d7254 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:28.809970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:28.810907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.811211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.811982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] PATH_INFO: `/v3/projects/9143c6c79eca4b49ad02f5ba56f8c32e/users/7088af9d3a094cec9a2a503c999aa33c/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.865583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9143c6c79eca4b49ad02f5ba56f8c32e, user_id=7088af9d3a094cec9a2a503c999aa33c, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:28.868591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:28.904268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 836/1680] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:28 2022] PUT /identity/v3/projects/9143c6c79eca4b49ad02f5ba56f8c32e/users/7088af9d3a094cec9a2a503c999aa33c/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:28.914226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af512-6611-451b-9f8d-995837786399 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:28.914753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af512-6611-451b-9f8d-995837786399 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:28.915199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af512-6611-451b-9f8d-995837786399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:28.988038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e57af512-6611-451b-9f8d-995837786399 None None] MFA Rules not processed for user `7088af9d3a094cec9a2a503c999aa33c`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:28.993490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e57af512-6611-451b-9f8d-995837786399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:29.129779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 845/1681] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:29.132304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:29.301079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4ba6-01e3-4c2c-85a4-031573875b71 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:29.317036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:29.317771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:29.318256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:29.321746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:29.322581 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:29.332349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:29.391001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 837/1682] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:29 2022] POST /identity/v3/projects => generated 357 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:29.392184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af512-6611-451b-9f8d-995837786399 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:29.415563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af512-6611-451b-9f8d-995837786399 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:29.640631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:29.651554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:29.652266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:29.652915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:29.653490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:29.658189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:29.658189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:29.717388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:29.735687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 846/1683] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:29 2022] POST /identity/v3/users => generated 285 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:29.743713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60e5c-0fbc-4f2c-a9ef-8e85c3090c3c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:29.772666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:29.773651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:29.778340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:29.778839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:29.797059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:29.804981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:29.842107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 838/1684] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:29.846694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:29.873684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2725c0-3dea-4a13-94f7-68e254db76f4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:29.893285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:29.895501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:29.901479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:29.902059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] PATH_INFO: `/v3/projects/770e207b2f70460592980177c84e33e5/users/c9b35acb614943e894ea0b5c2d3221d3/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:29.944379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e207b2f70460592980177c84e33e5, user_id=c9b35acb614943e894ea0b5c2d3221d3, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:29.949303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:29.974373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 847/1685] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:29 2022] PUT /identity/v3/projects/770e207b2f70460592980177c84e33e5/users/c9b35acb614943e894ea0b5c2d3221d3/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:29.976099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:29.999483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089025c-8528-4368-bf93-eff81d175669 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:30.152313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:30.184384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187215c-1735-4813-a515-6746596a392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:30.185296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187215c-1735-4813-a515-6746596a392e admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:30.189074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187215c-1735-4813-a515-6746596a392e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:30.189560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187215c-1735-4813-a515-6746596a392e admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:30.191059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187215c-1735-4813-a515-6746596a392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:30.194712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187215c-1735-4813-a515-6746596a392e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:30.241977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 839/1686] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:30.243645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:30.281615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c6df0-06a3-4b3d-8bc4-a685c3ccd65e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:30.291812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:30.294342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:30.294792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:30.295243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] PATH_INFO: `/v3/projects/770e207b2f70460592980177c84e33e5/users/c9b35acb614943e894ea0b5c2d3221d3/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:30.301329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e207b2f70460592980177c84e33e5, user_id=c9b35acb614943e894ea0b5c2d3221d3, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:30.310193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:30.359211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 848/1687] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:30 2022] PUT /identity/v3/projects/770e207b2f70460592980177c84e33e5/users/c9b35acb614943e894ea0b5c2d3221d3/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:30.361577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:30.362441 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:30.362672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:30.413378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] MFA Rules not processed for user `c9b35acb614943e894ea0b5c2d3221d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:30.437929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:30.633511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 840/1688] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:30.640681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:30.644215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:30.842313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06055bd8-3d0e-45cc-bd2c-2c7179ae0423 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:30.851191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:30.851736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:30.851950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:30.852751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:30.866533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:30.868911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bd02f-f564-4b86-a414-c82689a9d0d8 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:30.889652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 849/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:30.987131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:30.999383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93a88-7c45-4747-a924-ed8c58d41cfb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:31.004320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:31.005235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.006463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.006983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:31.100811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:31.102402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1fa65-430d-4a50-afcc-d4f7edd1c150 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:31.128485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 841/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:30 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:31.462473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34d2-1053-4e16-94b1-0fe59e905a87 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.463006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34d2-1053-4e16-94b1-0fe59e905a87 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.464222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34d2-1053-4e16-94b1-0fe59e905a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:31.543066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-353f34d2-1053-4e16-94b1-0fe59e905a87 None None] MFA Rules not processed for user `45c80d80bae843b3abdfdfb1d54ca205`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:31.545575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-353f34d2-1053-4e16-94b1-0fe59e905a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:31.692146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 850/1691] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:31.692424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.692840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.693177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:31.715408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.715692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.715972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:31.733460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] MFA Rules not processed for user `45c80d80bae843b3abdfdfb1d54ca205`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:31.736463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:31.759240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 842/1692] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:31.768556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:31.770393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:31.815465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] MFA Rules not processed for user `351cf9e695324a38afd389705402feb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:31.816909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:31.872292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:31.879997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0d4f8-d223-4b9e-862a-f79b1814b042 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:31.889186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:31.890830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.892683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.892913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:31.908461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:31.910118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30600af6-eb8f-49b6-82bf-8b8a02e17980 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:31.926123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:31.937375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 843/1693] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:31.944524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:31.945037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:31.945461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.008039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 851/1694] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:32.012259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.013854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:32.027925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] MFA Rules not processed for user `be0580895be5441d8503d584b33fa954`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:32.041928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:32.185420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3de7-e5f4-4ed3-941f-776bd344cd59 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:32.198099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:32.199315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:32.199594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:32.200885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.201621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:32.204912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:32.207326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 844/1695] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:32.227566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.229733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:32.277282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156a6de-98d4-4134-a413-3ba616b52153 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:32.291650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:32.294772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 852/1696] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:32 2022] POST /identity/v3/projects => generated 403 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:42:32.295917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:32.296449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:32.297096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.298027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.320357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:32.327010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:32.359362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 845/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:32.540109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c955c6-5c77-49be-bc6a-00c6e537923c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:32.545345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:32.546122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:32.546411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:32.546757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.547500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:32.550742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:32.590197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.590381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 853/1698] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:32 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:32.606252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eefff-91ba-4694-850e-4bc08b877b8a service nova] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:32.613513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:32.613825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:32.614078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:32.614550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.615859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:32.626649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:32.671300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.683683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 846/1699] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:32.690087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23541-ff2b-4a87-8241-313111b40f56 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:32.699536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:32.700484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:32.700740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:32.701021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] PATH_INFO: `/v3/projects/9666f388e9b64b5ab7970230038b63b9/users/805251de02b642ba80f141216c105e8c/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:32.734068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9666f388e9b64b5ab7970230038b63b9, user_id=805251de02b642ba80f141216c105e8c, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:32.738546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:32.761797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 854/1700] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:32 2022] PUT /identity/v3/projects/9666f388e9b64b5ab7970230038b63b9/users/805251de02b642ba80f141216c105e8c/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:32.762821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:32.798406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c6f6-0e8c-445f-b4d8-50ae84d829e0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:33.019415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:33.020779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.021316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.021776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.022658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:33.028862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41ed2-ef69-4bed-9355-e471a981b231 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:33.057673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 847/1701] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:33.062904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:33.081287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0df0b-81d5-4caf-891a-0c44d2794f98 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:33.102549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b2-9ae6-4378-a830-b585ea336d3b None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.103290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b2-9ae6-4378-a830-b585ea336d3b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.103734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300518b2-9ae6-4378-a830-b585ea336d3b None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.105427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 848/1702] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 13 20:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:33.111346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:33.116892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a078fb-06a4-4a1f-84a1-fb0cc7ff7b72 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.117182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.117531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.117798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a078fb-06a4-4a1f-84a1-fb0cc7ff7b72 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.118214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a078fb-06a4-4a1f-84a1-fb0cc7ff7b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.118530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] PATH_INFO: `/v3/projects/9666f388e9b64b5ab7970230038b63b9/users/805251de02b642ba80f141216c105e8c/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.125920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9666f388e9b64b5ab7970230038b63b9, user_id=805251de02b642ba80f141216c105e8c, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:33.155009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:33.195781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-91a078fb-06a4-4a1f-84a1-fb0cc7ff7b72 None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:33.197068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-91a078fb-06a4-4a1f-84a1-fb0cc7ff7b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:33.197347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 855/1703] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:33 2022] PUT /identity/v3/projects/9666f388e9b64b5ab7970230038b63b9/users/805251de02b642ba80f141216c105e8c/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:33.250532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:33.285625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 849/1704] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:42:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:33.327534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:33.329269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:33.352267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0f63-1dcc-4d02-8963-014612342c5a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:33.357439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:33.357439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.357824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.358006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.370616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:33.378162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:33.379691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb50f16-ff6f-4092-a804-91b7eb594706 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:33.401972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 856/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:33.815321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:33.815914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:33.816303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:33.924466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] MFA Rules not processed for user `0e69fea1eeb5453aa4b09799894b1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:33.932281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:34.240230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 850/1706] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:34.251680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdb2a-3be0-4709-8be7-3fee8568f284 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:34.252259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdb2a-3be0-4709-8be7-3fee8568f284 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:34.252657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdb2a-3be0-4709-8be7-3fee8568f284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:34.325521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-63cbdb2a-3be0-4709-8be7-3fee8568f284 None None] MFA Rules not processed for user `0e69fea1eeb5453aa4b09799894b1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:34.326789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-63cbdb2a-3be0-4709-8be7-3fee8568f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:34.358393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 857/1707] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:34.371049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:34.706459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f037c9-b857-4ff1-9786-52a3927a527e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:34.747138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:34.747138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:34.747138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:34.747138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:34.808024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:34.809812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad476b-2a08-4431-87e5-1713edd365c5 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:34.837429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 851/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:35.195032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327904d-2c8a-436d-8f13-b86547a72167 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:35.195268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327904d-2c8a-436d-8f13-b86547a72167 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:35.195715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327904d-2c8a-436d-8f13-b86547a72167 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:35.197273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 858/1709] 10.222.0.27 () {54 vars in 960 bytes} [Wed Jul 13 20:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:35.203195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb4cb-61fd-475b-8428-de08844a25f7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:35.203682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb4cb-61fd-475b-8428-de08844a25f7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:35.204159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb4cb-61fd-475b-8428-de08844a25f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:35.244644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-31feb4cb-61fd-475b-8428-de08844a25f7 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:35.248872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-31feb4cb-61fd-475b-8428-de08844a25f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:35.392893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:35.413798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 852/1710] 10.222.0.27 () {58 vars in 1057 bytes} [Wed Jul 13 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:35.421599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327904d-2c8a-436d-8f13-b86547a72167 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:35.450590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327904d-2c8a-436d-8f13-b86547a72167 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:35.479738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:35.480538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:35.480836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:35.481118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:35.485340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:35.520986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:35.524050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac3f2-b89c-420e-b503-8d01806ac829 service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:35.559842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 859/1711] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:36.408363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7584b-2fbf-4a15-b52e-975febadb02b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:36.408986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7584b-2fbf-4a15-b52e-975febadb02b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:36.408986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7584b-2fbf-4a15-b52e-975febadb02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:36.499145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-37a7584b-2fbf-4a15-b52e-975febadb02b None None] MFA Rules not processed for user `805251de02b642ba80f141216c105e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:36.500654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-37a7584b-2fbf-4a15-b52e-975febadb02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:36.728079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 853/1712] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:36.792197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:36.792705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:36.792986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:36.795337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 860/1713] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 13 20:42:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:36.807923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576472c-6e39-43df-b984-6f34b1a47da9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:36.808645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576472c-6e39-43df-b984-6f34b1a47da9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:36.809155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576472c-6e39-43df-b984-6f34b1a47da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:36.846674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f576472c-6e39-43df-b984-6f34b1a47da9 None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:36.851990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f576472c-6e39-43df-b984-6f34b1a47da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:36.877890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 854/1714] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:36.915449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:36.918633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:36.947838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997bf47-03fb-47c3-ae1f-899777f140f4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:36.963362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:36.966430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:36.967506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:36.968971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:36.993830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:36.997223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4ced3-f119-43ec-94d5-f40a35a8a6e5 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:37.024437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 861/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:38.301748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16127f-8ebc-4236-8628-46bcf3376069 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:38.302650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16127f-8ebc-4236-8628-46bcf3376069 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:38.302650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16127f-8ebc-4236-8628-46bcf3376069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:38.410458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dd3-e899-4e9a-af05-42a1909acd3a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:38.411445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dd3-e899-4e9a-af05-42a1909acd3a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:38.411852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca592dd3-e899-4e9a-af05-42a1909acd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:38.426207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8e16127f-8ebc-4236-8628-46bcf3376069 None None] MFA Rules not processed for user `c26c047c73a748cda14345a2ca3aa319`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:38.431098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8e16127f-8ebc-4236-8628-46bcf3376069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:38.464602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ca592dd3-e899-4e9a-af05-42a1909acd3a None None] MFA Rules not processed for user `be0580895be5441d8503d584b33fa954`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:38.466318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ca592dd3-e899-4e9a-af05-42a1909acd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:38.752903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 855/1716] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:38.754360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947115c-c6fc-4056-8451-9ee9d81d4491 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:38.754651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947115c-c6fc-4056-8451-9ee9d81d4491 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:38.754998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947115c-c6fc-4056-8451-9ee9d81d4491 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:38.758391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 862/1717] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:38.760938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 856/1718] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:42:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:38.763097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:38.763392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:38.763672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:38.841308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:38.842660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:38.902667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:38.903950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:38.904897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:38.949919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] MFA Rules not processed for user `0e69fea1eeb5453aa4b09799894b1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:38.951342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 863/1719] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:38.952056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:38.952385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:38.983671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 857/1720] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:38.986003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:38.992322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:39.037352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2822c-e611-4719-a527-3e53816a77ac None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:39.047732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c54c1e-fb4c-4f80-bb57-c94dc2ce17fb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:39.059010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:39.059690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:39.059968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:39.060242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:39.062283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:39.066049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:39.066516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:39.067143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:39.093589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:39.096071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:39.099396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:39.100058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b90d-a039-4a5c-b43c-633603f8b7ca service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:39.124853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 864/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:39.158202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 858/1722] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:39.271442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:39.271542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:39.271802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:39.516795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:39.520721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:39.701837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 865/1723] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:42:39.996919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:39.999234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:40.133096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:40.289150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1d0a7-fdea-4055-834e-892fc0bc2893 service placement] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:40.311111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:40.313340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:40.313876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:40.314361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:40.335697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:40.349962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:40.378409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 859/1724] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:42:40.412827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:40.414774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:40.529753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:40.896581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af293e0-f8cb-4b30-a932-8ffaa27b55b6 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:40.927260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:40.942181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:40.944340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:40.948846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] PATH_INFO: `/v3/users/f1fbd61979b9407bb01e75e7cbd9346d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:40.955205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fbd61979b9407bb01e75e7cbd9346d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:40.965552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: WARNING py.warnings [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 20:42:40.965552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: warnings.warn(msg) Jul 13 20:42:40.965552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: Jul 13 20:42:40.976051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:41.178599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:41.201233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c183c-3d34-48d5-944d-3c330d4264d9 service swift] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:41.223697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:41.225257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:41.225695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:41.226165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] PATH_INFO: `/v3/users/351cf9e695324a38afd389705402feb0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:41.234126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351cf9e695324a38afd389705402feb0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:41.243940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:41.287525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fbd61979b9407bb01e75e7cbd9346d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.425197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fbd61979b9407bb01e75e7cbd9346d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.434644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fbd61979b9407bb01e75e7cbd9346d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.519959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fbd61979b9407bb01e75e7cbd9346d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.555228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2df0e0ce-74b9-4c9e-8273-2db13dd83103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fbd61979b9407bb01e75e7cbd9346d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.565920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351cf9e695324a38afd389705402feb0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.568963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351cf9e695324a38afd389705402feb0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.598392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 866/1725] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:40 2022] DELETE /identity/v3/users/f1fbd61979b9407bb01e75e7cbd9346d => generated 0 bytes in 1185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:41.604696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351cf9e695324a38afd389705402feb0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.605637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:41.605965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:41.606248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:41.616543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351cf9e695324a38afd389705402feb0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.696762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351cf9e695324a38afd389705402feb0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:41.729422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:41.735512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:41.766792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 860/1726] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:41 2022] DELETE /identity/v3/users/351cf9e695324a38afd389705402feb0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:42.045800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 867/1727] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:42.699095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:42.700691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:42.968451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc1913-765d-4cab-9852-c0d5ac4478e0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:42.979239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:42.981430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:42.981867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:42.986276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:43.136273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:43.194048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:43.198944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:43.258330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 861/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:44.406185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:44.410539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:44.491287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4291-1ece-45c7-95cf-3890b9d4bde2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:44.507238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:44.509297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:44.509824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:44.510114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] PATH_INFO: `/v3/projects/f9da446f4b3b4db59b1ce782ec77b330` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:44.515181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9da446f4b3b4db59b1ce782ec77b330)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:44.527393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:44.630055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:44.658590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9da446f4b3b4db59b1ce782ec77b330', 'request_id': 'req-431fe13c-2aa7-4a66-836c-f3b99348ab24'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:44.673912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9da446f4b3b4db59b1ce782ec77b330', 'request_id': 'req-431fe13c-2aa7-4a66-836c-f3b99348ab24'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:44.698304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9da446f4b3b4db59b1ce782ec77b330', 'request_id': 'req-431fe13c-2aa7-4a66-836c-f3b99348ab24'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:44.745391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] The token cache is being invalidate because project f9da446f4b3b4db59b1ce782ec77b330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:44.745698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:44.748311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-431fe13c-2aa7-4a66-836c-f3b99348ab24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:44.753389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 868/1729] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:44 2022] DELETE /identity/v3/projects/f9da446f4b3b4db59b1ce782ec77b330 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:44.757509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:44.782557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9a9e-b4a8-4553-9237-9942ef5218dc service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:45.072186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:45.078571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:45.079060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:45.079356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] PATH_INFO: `/v3/users/805251de02b642ba80f141216c105e8c` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:45.085101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805251de02b642ba80f141216c105e8c)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:45.094061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:45.234373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805251de02b642ba80f141216c105e8c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:45.235103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805251de02b642ba80f141216c105e8c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:45.245940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805251de02b642ba80f141216c105e8c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:45.247184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805251de02b642ba80f141216c105e8c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:45.269782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805251de02b642ba80f141216c105e8c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:45.333069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 862/1730] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:44 2022] DELETE /identity/v3/users/805251de02b642ba80f141216c105e8c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:42:45.573407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:45.573966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:45.574039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:45.584358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:45.586359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:45.661900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:45.666610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:45.965345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9529f-22a8-478d-968a-e333416dd261 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:46.008837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 869/1731] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jul 13 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:46.010117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:46.017781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:46.022810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:46.023935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.024520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.029616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] PATH_INFO: `/v3/projects/ea62df9ad2df4e4aa023bc6daf811863` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.037308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea62df9ad2df4e4aa023bc6daf811863)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:46.045949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:46.054238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:46.100715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6da3-9f9f-421a-bfe1-300e0c0a5fe3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:46.122887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:46.124694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.125740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.126266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] PATH_INFO: `/v3/projects/9666f388e9b64b5ab7970230038b63b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.129858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9666f388e9b64b5ab7970230038b63b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:46.136148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:46.259290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea62df9ad2df4e4aa023bc6daf811863', 'request_id': 'req-9f791f59-6904-4b46-8262-28163674ff20'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.277826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea62df9ad2df4e4aa023bc6daf811863', 'request_id': 'req-9f791f59-6904-4b46-8262-28163674ff20'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.293349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea62df9ad2df4e4aa023bc6daf811863', 'request_id': 'req-9f791f59-6904-4b46-8262-28163674ff20'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.338347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9666f388e9b64b5ab7970230038b63b9', 'request_id': 'req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.351621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] The token cache is being invalidate because project ea62df9ad2df4e4aa023bc6daf811863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:46.353275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.355279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.365651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9666f388e9b64b5ab7970230038b63b9', 'request_id': 'req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.365994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 863/1732] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:45 2022] DELETE /identity/v3/projects/ea62df9ad2df4e4aa023bc6daf811863 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:42:46.368412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:46.373778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:46.396262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9666f388e9b64b5ab7970230038b63b9', 'request_id': 'req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.435000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] The token cache is being invalidate because project 9666f388e9b64b5ab7970230038b63b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:46.435706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.438619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.444678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 870/1733] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:46 2022] DELETE /identity/v3/projects/9666f388e9b64b5ab7970230038b63b9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:46.446258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:46.449188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:46.592380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791f59-6904-4b46-8262-28163674ff20 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:46.633651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:46.651082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e3487-1fa5-47e1-a17c-6858c629f2d1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:46.675188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:46.676323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.676453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.676742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] PATH_INFO: `/v3/users/913abf964936423a9b855cd6c236754b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.678429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913abf964936423a9b855cd6c236754b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:46.680737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:46.821639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:46.822626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.822943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.823219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.827497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:46.854323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:46.856195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53709b-46ae-4b93-a319-269fe56439e4 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:46.873480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913abf964936423a9b855cd6c236754b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.885788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 864/1734] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:46.891740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81a68-2274-422d-9a68-ca1c66f9bf86 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.892045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81a68-2274-422d-9a68-ca1c66f9bf86 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.892586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81a68-2274-422d-9a68-ca1c66f9bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.938430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913abf964936423a9b855cd6c236754b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.940584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-44e81a68-2274-422d-9a68-ca1c66f9bf86 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:46.941625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913abf964936423a9b855cd6c236754b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:46.945550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-44e81a68-2274-422d-9a68-ca1c66f9bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:46.974482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 865/1735] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:46.982403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:46.982989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:46.983287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:46.994281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913abf964936423a9b855cd6c236754b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:47.022684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913abf964936423a9b855cd6c236754b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:47.051121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 871/1736] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:46 2022] DELETE /identity/v3/users/913abf964936423a9b855cd6c236754b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:47.086000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:47.087386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:47.358297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:47.458069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 866/1737] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:47.459282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:47.477499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bbc10-b016-4d7e-bf33-0e6098420f57 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:47.505757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:47.507100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:47.507941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:47.508471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:47.509691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:47.510221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:47.518437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:47.605558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 872/1738] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:42:47.611760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:47.622589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79181714-d9b2-40e4-9218-9ea8d264f93c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:47.684763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:47.685564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:47.685850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:47.686124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:47.686840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:47.688840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:47.859211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 867/1739] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:47 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:47.864002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:47.878346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4a618-1ca5-4c2e-ac87-f741b98efb5a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:48.184504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:48.185221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:48.185508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:48.185783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:48.186503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:48.192692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:48.265425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 873/1740] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:47 2022] POST /identity/v3/users => generated 294 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:42:48.266517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:48.313358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30572a18-a993-4d07-9cf8-e483944a9ea7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:48.339830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:48.343268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:48.344525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:48.347259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:48.353731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:48.361457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:48.394551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:48.408112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 868/1741] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:48.409719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532572a5-8b17-423d-bc52-a0834f69b6d5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:48.417194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:48.418710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:48.419943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:48.420990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:48.423868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:48.428080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0456-5476-4898-8342-31bf7ff88085 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:48.493972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 874/1742] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:42:48.499502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:48.530950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45f1f4-823b-4253-bbd6-aaf92808d9dc admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:48.544329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:48.545534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:48.547677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:48.547677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] PATH_INFO: `/v3/projects/c2b64d69882649949ef7d31f041e7ff8/users/82de6dc323d145deaf9ed52b1cb75180/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:48.591499 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b64d69882649949ef7d31f041e7ff8, user_id=82de6dc323d145deaf9ed52b1cb75180, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:48.603825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:48.661406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 869/1743] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:48 2022] PUT /identity/v3/projects/c2b64d69882649949ef7d31f041e7ff8/users/82de6dc323d145deaf9ed52b1cb75180/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:48.663612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:48.663999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:48.664327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:48.719690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] MFA Rules not processed for user `82de6dc323d145deaf9ed52b1cb75180`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:48.719690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:48.765476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:48.878310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:48.879551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 875/1744] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:49.018874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e983-728e-464d-a7af-f80c97c7bb3d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:49.035540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:49.036804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:49.037325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:49.037828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:49.038788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:49.045241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:49.111899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 870/1745] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:48 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:42:49.123201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:49.159500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca8e43-bc68-490b-813c-2051edac36ee None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:49.322726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:49.345987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:49.347505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:49.349815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:49.352767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:49.362501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:49.437830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 876/1746] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:49 2022] POST /identity/v3/users => generated 300 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:49.454233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:49.466236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d433666-8660-4e73-992e-a8fa82eb55d9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:49.485196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:49.487689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:49.488360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:49.489381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:49.504084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:49.512613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:49.558087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:49.580056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 871/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:49.600960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2d55-91aa-4a05-8e56-7efe4b80dcee admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:49.638906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:49.640255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:49.642691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:49.643753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] PATH_INFO: `/v3/projects/abf7c823e7e94449983a64cffbf21c06/users/2d9339a5e5744e89bf136442457bd522/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:49.731962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf7c823e7e94449983a64cffbf21c06, user_id=2d9339a5e5744e89bf136442457bd522, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:49.739052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:49.783933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 877/1748] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:49 2022] PUT /identity/v3/projects/abf7c823e7e94449983a64cffbf21c06/users/2d9339a5e5744e89bf136442457bd522/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:42:49.795258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:49.825429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dfcfe-4439-4a95-943d-f9c0c71dbe67 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:49.987665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:49.989911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:49.990209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:49.993549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:49.994889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:50.005121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718aa0-8ab8-47ff-9305-7184245f7e55 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:50.007034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:50.039360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 872/1749] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:50.040819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:50.058838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29121517-effd-439e-8032-8bcde1111215 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:50.075922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:50.081155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.082691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.084259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] PATH_INFO: `/v3/projects/abf7c823e7e94449983a64cffbf21c06/users/2d9339a5e5744e89bf136442457bd522/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:50.095362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf7c823e7e94449983a64cffbf21c06, user_id=2d9339a5e5744e89bf136442457bd522, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:50.101827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:50.137524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 878/1750] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:50 2022] PUT /identity/v3/projects/abf7c823e7e94449983a64cffbf21c06/users/2d9339a5e5744e89bf136442457bd522/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:50.156978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.157561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.157990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:50.221463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] MFA Rules not processed for user `2d9339a5e5744e89bf136442457bd522`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:50.223864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:50.340958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 873/1751] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:50.354061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:50.360249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:50.606875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:50.609233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:50.649125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb07697-26cf-4839-a21d-a317dbf9c3d2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:50.688127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:50.690225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.697279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.697575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:50.768826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:50.770408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e9e2-0ddc-427e-8a23-8e5a28128f81 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:50.820666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 879/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:50.823124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451993-1dfe-4cbc-8aa9-847da3650087 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.823514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451993-1dfe-4cbc-8aa9-847da3650087 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.823804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3451993-1dfe-4cbc-8aa9-847da3650087 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:50.825519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 880/1753] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:50.934484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451993-1dfe-4cbc-8aa9-847da3650087 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:50.935274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e1369-7028-4034-9b4a-fbd9112090f3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:50.943534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:50.944452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.945468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.946450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] PATH_INFO: `/v3/projects/152db635f336406bb335738726d5cfd1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:50.948076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=152db635f336406bb335738726d5cfd1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:50.950574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:50.967848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3451993-1dfe-4cbc-8aa9-847da3650087 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:50.995990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:50.998045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:50.998594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:50.999102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] PATH_INFO: `/v3/users/82de6dc323d145deaf9ed52b1cb75180` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.007944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82de6dc323d145deaf9ed52b1cb75180)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:51.011111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:51.076744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:51.096858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152db635f336406bb335738726d5cfd1', 'request_id': 'req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.117436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152db635f336406bb335738726d5cfd1', 'request_id': 'req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.133712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152db635f336406bb335738726d5cfd1', 'request_id': 'req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.158897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82de6dc323d145deaf9ed52b1cb75180'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.177560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] The token cache is being invalidate because project 152db635f336406bb335738726d5cfd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:51.178051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.187246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2a1d16ea-f3ae-46ab-8c51-f38acb7c9f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.193582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82de6dc323d145deaf9ed52b1cb75180'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.197571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 874/1754] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:50 2022] DELETE /identity/v3/projects/152db635f336406bb335738726d5cfd1 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:42:51.201134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82de6dc323d145deaf9ed52b1cb75180'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.209320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3e02-0817-4900-b958-cc25d2e87c6a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.209720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3e02-0817-4900-b958-cc25d2e87c6a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.210146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3e02-0817-4900-b958-cc25d2e87c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.240458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82de6dc323d145deaf9ed52b1cb75180'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.263071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5ad353a7-7696-49c9-b2af-ac37b9f4a216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82de6dc323d145deaf9ed52b1cb75180'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:51.289556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 881/1755] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:50 2022] DELETE /identity/v3/users/82de6dc323d145deaf9ed52b1cb75180 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:51.292921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc3c7-eabc-41d4-b81a-b8a7aadfb3fa None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.293315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-266c3e02-0817-4900-b958-cc25d2e87c6a None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:51.294668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc3c7-eabc-41d4-b81a-b8a7aadfb3fa None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.295052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-266c3e02-0817-4900-b958-cc25d2e87c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:51.295410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc3c7-eabc-41d4-b81a-b8a7aadfb3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.302329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:51.397143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8cafc3c7-eabc-41d4-b81a-b8a7aadfb3fa None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:51.400787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8cafc3c7-eabc-41d4-b81a-b8a7aadfb3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:51.520826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 882/1756] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:51.525877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.526639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.527406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.533552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 875/1757] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:51.535060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.535458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.535786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.568318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:51.572594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:51.594058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 883/1758] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:51.596714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:51.598189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:51.617470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 876/1759] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:51.622223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:51.635410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02fa77-5677-4930-99c0-8ae84cb48ef0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:51.651865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:51.652730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.652862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.654043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.655759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:51.656737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:51.659457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:51.698908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:51.700678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:51.733391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 884/1760] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:51.740070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:51.790171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772103-b25e-4c77-b98f-81960743e86a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:51.819633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:51.821123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:51.822956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:51.823359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:51.825626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:51.830710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:51.912470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 885/1761] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:51.913926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:51.937729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217fd5b-49f7-45f8-9c7e-d18f2a07c217 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.122486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.125727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.126222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.126591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.150310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:52.164999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c266af-7d4b-494b-adb4-2475565a3f79 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.168011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.172595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.172864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.173531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.174196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.174577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.175611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.180311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.203098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 877/1762] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:42:52.206745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:52.211047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:52.222610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 886/1763] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:51 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:52.228348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:52.252082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b5ea-f820-425a-b425-62760b18c8d4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.268149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.269293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.269556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.270101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.271608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.273353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.301874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 887/1764] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:52.302816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:52.317412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a800e5-638e-4cf3-beb9-81e9dd33749f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.324288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.325416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.325940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.326441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.327403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.329646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.358147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 888/1765] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:52.359635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:52.391499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02497-1b78-436a-9752-d6db8f24e704 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.413562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.415170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.415490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.415908 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] PATH_INFO: `/v3/projects/263300d353744eb2a17686e6416f6c5d/users/e409778e13ed45c2bf5dd636e78dadb9/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.416825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:52.471987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] RBAC: Authorizing `identity:create_grant(project_id=263300d353744eb2a17686e6416f6c5d, user_id=e409778e13ed45c2bf5dd636e78dadb9, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.479937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b576-6ecc-4b4b-8947-2c14910e71be admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.502035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d20b0-522b-45f1-b018-6d89619157c2 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:52.531903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:52.533901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.534195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.536163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.547292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 889/1766] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:52 2022] PUT /identity/v3/projects/263300d353744eb2a17686e6416f6c5d/users/e409778e13ed45c2bf5dd636e78dadb9/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:52.558323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:52.559211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:52.559985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:52.570549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:52.574882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:52.607674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 878/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:52.664701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] MFA Rules not processed for user `e409778e13ed45c2bf5dd636e78dadb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:52.667470 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:53.085050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 890/1768] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:53.091183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:53.108805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7883647-bb7f-4da9-9857-27b81369efd0 service nova] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:53.337874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:53.341937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:53.342231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:53.342513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:53.344601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:53.349253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:53.444162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 879/1769] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:53 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:42:53.449829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:53.478148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b062-233b-4d17-9b8b-94ccd2c9bff0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:53.693147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:53.694395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:53.694734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:53.695572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:53.695871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:53.701706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:53.754309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 891/1770] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:53 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:53.755708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:53.783964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b7e70-b10e-4f7d-bbf9-bd56f9d734ee admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:53.804167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:53.805144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:53.805529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:53.805936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:53.806943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:53.809031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:53.855604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 880/1771] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:53.860165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:53.874128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727473-5940-48a7-a529-e7c8c351edb1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:53.888521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:53.888982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:53.889306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:53.889581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:53.890344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:53.896034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa9ff-3c6b-4115-9c32-987335da02e3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:53.924544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 892/1772] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:53.925498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:53.950616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b020d-6b74-4c9e-b611-2ba5bf1df5ce admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:53.971212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:53.971728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:53.971984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:53.972244 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] PATH_INFO: `/v3/projects/d39fb5f3506644cebf910d43d0e6d898/users/0c98d34dab7c4593a42d66e41d2531f5/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:54.026863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39fb5f3506644cebf910d43d0e6d898, user_id=0c98d34dab7c4593a42d66e41d2531f5, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:54.030417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3dcf5-a7bd-4b59-8b3e-4e59ab451710 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:54.077989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 881/1773] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:53 2022] PUT /identity/v3/projects/d39fb5f3506644cebf910d43d0e6d898/users/0c98d34dab7c4593a42d66e41d2531f5/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:54.090639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:54.091168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:54.091471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:54.115065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:54.164634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] MFA Rules not processed for user `0c98d34dab7c4593a42d66e41d2531f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:54.166115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:54.358783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:54.359448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:54.359448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:54.403932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 893/1774] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:54.409619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:54.426303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] MFA Rules not processed for user `c26c047c73a748cda14345a2ca3aa319`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:54.434596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:54.650530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867b5b7-eb15-4165-aadb-09c68445d9e5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:54.665239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:54.665239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:54.665537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:54.665933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:54.672179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:54.672179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:54.711447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 882/1775] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:54.745179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:54.745891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 894/1776] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:54 2022] POST /identity/v3/projects => generated 377 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:54.761397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5d20-660e-4dc0-b699-64aeeda214b2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:54.886095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:54.888284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:54.897827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:54.942261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:54.943548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:54.944760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:54.945280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:54.946960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:54.949818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.004741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 883/1777] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:54 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:55.019679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:55.051602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815966bb-e859-4e0a-8bb2-83860455c964 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.074236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:55.075224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.075659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.076090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.077328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:55.079784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.101844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 884/1778] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:55.106114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:55.140642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9a90-5e9b-404c-bb51-478240106855 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.150057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3848d8e-01ad-43c9-bb2a-4861b142837c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.164685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:55.168187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.168729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.169119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] PATH_INFO: `/v3/users/7088af9d3a094cec9a2a503c999aa33c` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.170562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7088af9d3a094cec9a2a503c999aa33c)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:55.178436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.194009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:55.195938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.206842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.211934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] PATH_INFO: `/v3/projects/62fff599964043359c89d82ea0cac34c/users/1b5f30ca2a214cd4b19ab1ed5c246e0e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.260185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fff599964043359c89d82ea0cac34c, user_id=1b5f30ca2a214cd4b19ab1ed5c246e0e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:55.268251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:55.269740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.322315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 885/1779] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:55 2022] PUT /identity/v3/projects/62fff599964043359c89d82ea0cac34c/users/1b5f30ca2a214cd4b19ab1ed5c246e0e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:55.323602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:55.326331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:55.363562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7088af9d3a094cec9a2a503c999aa33c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.423906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7088af9d3a094cec9a2a503c999aa33c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.426067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7088af9d3a094cec9a2a503c999aa33c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.462559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7088af9d3a094cec9a2a503c999aa33c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.489043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7088af9d3a094cec9a2a503c999aa33c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.510875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 895/1780] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:54 2022] DELETE /identity/v3/users/7088af9d3a094cec9a2a503c999aa33c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:55.514695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:55.521820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:55.586310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a1be6-feb1-44d1-aa8e-718d90be91b9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.717858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2888-4396-436c-80ee-8b3df2b0ed94 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.728306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:55.729098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.729548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.729890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.731679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:55.733961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bb94-7822-4a59-83c3-254e97c15dd0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.773243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 896/1781] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:42:55.789072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.789294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.791806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.818603 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:55.820036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:55.820036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:55.820036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] PATH_INFO: `/v3/projects/c2b64d69882649949ef7d31f041e7ff8` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:55.823964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b64d69882649949ef7d31f041e7ff8)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:55.830174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:55.861827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:55.868555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:55.903742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 897/1782] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:55.905876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:55.930432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:55.942063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933555fb-fa14-4310-bf55-2ae87013b0d2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:55.952433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b64d69882649949ef7d31f041e7ff8', 'request_id': 'req-9a8f7351-79c7-4464-86a4-cf0f23804cdf'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.978238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b64d69882649949ef7d31f041e7ff8', 'request_id': 'req-9a8f7351-79c7-4464-86a4-cf0f23804cdf'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:55.989652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b64d69882649949ef7d31f041e7ff8', 'request_id': 'req-9a8f7351-79c7-4464-86a4-cf0f23804cdf'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.008434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] The token cache is being invalidate because project c2b64d69882649949ef7d31f041e7ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:56.008797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.009726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.011700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 886/1783] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:55 2022] DELETE /identity/v3/projects/c2b64d69882649949ef7d31f041e7ff8 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:56.023656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:56.028056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.122441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:56.123632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:56.124222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:56.125767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] PATH_INFO: `/v3/projects/62fff599964043359c89d82ea0cac34c/users/1b5f30ca2a214cd4b19ab1ed5c246e0e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:56.128904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fff599964043359c89d82ea0cac34c, user_id=1b5f30ca2a214cd4b19ab1ed5c246e0e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:56.132254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdfbc4-dfc8-4e2f-9dd8-4e92d8a1290d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:56.147415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 898/1784] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:42:55 2022] PUT /identity/v3/projects/62fff599964043359c89d82ea0cac34c/users/1b5f30ca2a214cd4b19ab1ed5c246e0e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:56.156205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f7351-79c7-4464-86a4-cf0f23804cdf admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:56.164237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:56.164574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:56.165004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:56.211191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] MFA Rules not processed for user `1b5f30ca2a214cd4b19ab1ed5c246e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:56.212580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.253764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:56.367373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:56.369047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:56.377961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:56.378344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] PATH_INFO: `/v3/users/2d9339a5e5744e89bf136442457bd522` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:56.383371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9339a5e5744e89bf136442457bd522)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:56.384013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:56.480248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 899/1785] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:56.481127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:56.487410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.601047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d696213-28d9-444e-96ec-1290d29ae1f0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:56.605101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9339a5e5744e89bf136442457bd522'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.607563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9339a5e5744e89bf136442457bd522'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.608081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:56.609201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:56.609689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:56.610154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:56.613675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.634198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9339a5e5744e89bf136442457bd522'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.635401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9339a5e5744e89bf136442457bd522'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.642176 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:56.646417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:56.694112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 900/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:56.695148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:56.697375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9339a5e5744e89bf136442457bd522'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:56.697549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.702363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:56.731600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 887/1787] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:56 2022] DELETE /identity/v3/users/2d9339a5e5744e89bf136442457bd522 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:56.801065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f2db-9602-435e-b827-4eb1076c1903 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:56.930038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:56.931037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:56.931388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:56.931733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:56.935043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:56.980109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:57.119097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:57.120871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5e271-0f93-4424-805f-49292b938af6 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:57.134304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 901/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:57.188750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:57.190225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:57.205522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d738d1-0341-4875-b005-4b700e242b75 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:57.211473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:57.212274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:57.212558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:57.212831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:57.214949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:57.302389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:57.304213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3b28c-2c42-4201-9868-22fa0f48a335 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:57.316639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 888/1789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:57.585786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:57.586082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:57.586399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:57.588463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 902/1790] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:42:57.625094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:57.625658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:57.625658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:57.671766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:57.677065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:57.835019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 889/1791] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:42:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:58.186397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:58.189819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.417399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:58.420181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.470344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9a5f-780e-4907-ace7-7a46cefb22e4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:58.498164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:58.499146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:58.500266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:58.500569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] PATH_INFO: `/v3/projects/9143c6c79eca4b49ad02f5ba56f8c32e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:58.502488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9143c6c79eca4b49ad02f5ba56f8c32e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:58.507015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:58.631413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805945-79be-498c-aa4c-e1508be2f3c4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:58.639710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:58.640642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:58.640958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:58.641216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] PATH_INFO: `/v3/users/1c3ea52f5b344fa1bd3688d963700473` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:58.643654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3ea52f5b344fa1bd3688d963700473)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:58.645681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:58.658906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9143c6c79eca4b49ad02f5ba56f8c32e', 'request_id': 'req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.674616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9143c6c79eca4b49ad02f5ba56f8c32e', 'request_id': 'req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.698511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9143c6c79eca4b49ad02f5ba56f8c32e', 'request_id': 'req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.709573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:58.732545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] The token cache is being invalidate because project 9143c6c79eca4b49ad02f5ba56f8c32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:58.732984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.734395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.737229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 903/1792] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:58 2022] DELETE /identity/v3/projects/9143c6c79eca4b49ad02f5ba56f8c32e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:58.739427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:58.742060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.760831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3ea52f5b344fa1bd3688d963700473'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.762169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3ea52f5b344fa1bd3688d963700473'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.773575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3ea52f5b344fa1bd3688d963700473'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.774907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3ea52f5b344fa1bd3688d963700473'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.800053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3ea52f5b344fa1bd3688d963700473'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:58.829033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 890/1793] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:58 2022] DELETE /identity/v3/users/1c3ea52f5b344fa1bd3688d963700473 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:58.829033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:58.829552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.837759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:58.867844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad989-0aa0-4b51-a4e6-c3db755e16d5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:58.930284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7475-e1a6-4ac8-b289-09aea762cd0f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:58.937674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:58.938391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:58.938740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:58.939039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:58.941188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.957965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:58.959967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:58.960137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:58.961184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:58.961637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:58.962044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] PATH_INFO: `/v3/projects/abf7c823e7e94449983a64cffbf21c06` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:58.963999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf7c823e7e94449983a64cffbf21c06)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:58.967148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:58.974727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 891/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:42:58.975522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:58.977293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:58.990964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d953fd-9bbb-4f68-9edb-34825d5eca9b service nova] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:58.997837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:58.999208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:58.999493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:58.999768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] PATH_INFO: `/v3/users/c9b35acb614943e894ea0b5c2d3221d3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.001016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b35acb614943e894ea0b5c2d3221d3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:59.003097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:59.039842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf7c823e7e94449983a64cffbf21c06', 'request_id': 'req-73e830ed-f213-4b84-9336-1ad94d0610b0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.050150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf7c823e7e94449983a64cffbf21c06', 'request_id': 'req-73e830ed-f213-4b84-9336-1ad94d0610b0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.059853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf7c823e7e94449983a64cffbf21c06', 'request_id': 'req-73e830ed-f213-4b84-9336-1ad94d0610b0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.081974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b35acb614943e894ea0b5c2d3221d3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.083061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b35acb614943e894ea0b5c2d3221d3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.083299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] The token cache is being invalidate because project abf7c823e7e94449983a64cffbf21c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:42:59.083746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.085086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-73e830ed-f213-4b84-9336-1ad94d0610b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.087310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 904/1795] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:42:58 2022] DELETE /identity/v3/projects/abf7c823e7e94449983a64cffbf21c06 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:59.089066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.089494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.090315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.103562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b35acb614943e894ea0b5c2d3221d3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.114002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:59.115424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:59.131229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b35acb614943e894ea0b5c2d3221d3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.164954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-636b6be4-cdc1-44a7-8e02-d3d2c0799806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b35acb614943e894ea0b5c2d3221d3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:42:59.192148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:59.205045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 892/1796] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:42:58 2022] DELETE /identity/v3/users/c9b35acb614943e894ea0b5c2d3221d3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:42:59.205045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432656ad-ade0-4270-85d7-c62d741dc433 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.205045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432656ad-ade0-4270-85d7-c62d741dc433 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.205045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432656ad-ade0-4270-85d7-c62d741dc433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.267903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 905/1797] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:59.270157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-432656ad-ade0-4270-85d7-c62d741dc433 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:59.271451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-432656ad-ade0-4270-85d7-c62d741dc433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:59.294290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:59.295936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:59.412422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:42:59.533921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 893/1798] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:59.535466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.535964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.536092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.536515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5b54d-75d6-49ed-84e0-47b5c6d8b622 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:59.606427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:42:59.607449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:42:59.655227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 894/1799] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:42:59.665713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:59.669946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.671433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.671946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.672067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:59.695782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:59.696708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a40d87-6aff-4b2f-ac25-a7c073e85660 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:59.698963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:59.707844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:59.708759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.709047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.709319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.710608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:42:59.710948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:59.713816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:59.724107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 906/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:42:59.735609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 895/1801] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:42:59.741130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:59.758241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3961f1-10fb-4dab-9157-d50055685492 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:59.766462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:59.767631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.768414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.768877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.771471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:59.779179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:42:59.865004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 907/1802] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:42:59 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:42:59.866264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:42:59.877650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece07d-09d9-4ade-b3bd-4dc0a83dc2dc admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:42:59.986277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:42:59.987236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:42:59.987777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:42:59.988226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:42:59.989775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:42:59.992738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.027687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 896/1803] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:42:59 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:00.031935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.046718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500507d-8c56-49d5-b6cf-105a297afbed admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.054682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.055849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.056159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.056436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.057824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.060088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.083527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 908/1804] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:00.085249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.101920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb714d-6c16-4ef4-9453-6af1c97f6870 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.108646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.110196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.110516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.110852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.111692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.113404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05316ff4-e47f-4213-8ce5-0750e723507c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.126181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 897/1805] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:00.131811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.160198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846988d-1e46-43e1-aafa-f0a6d7ba8033 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.170196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.171558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.172310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.172684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] PATH_INFO: `/v3/projects/eebe667db35943bda1e95111613d9d12/users/3aaf335e3daf4a759d8e1c0cca404b18/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.211505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebe667db35943bda1e95111613d9d12, user_id=3aaf335e3daf4a759d8e1c0cca404b18, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.214904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.241757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 909/1806] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:00 2022] PUT /identity/v3/projects/eebe667db35943bda1e95111613d9d12/users/3aaf335e3daf4a759d8e1c0cca404b18/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:00.251912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.252204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.253078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.285866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] MFA Rules not processed for user `3aaf335e3daf4a759d8e1c0cca404b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:00.287470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.346803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:00.354544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.358396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.382933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 898/1807] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:00.395135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.529120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf526-014a-4400-985c-04333184bd1e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.537631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.538478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.538771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.539156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.540887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.543190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.555036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137fed-8a75-4082-ba34-2bca67f901fd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.567984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.569359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.569359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.570247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] PATH_INFO: `/v3/projects/770e207b2f70460592980177c84e33e5` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.580073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=770e207b2f70460592980177c84e33e5)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.582186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.604826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 899/1808] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:00 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:00.608801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.651655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:00.687693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770e207b2f70460592980177c84e33e5', 'request_id': 'req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.694073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812d715-37fa-4a1f-a4fa-ca0f217f7fbb admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.704367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770e207b2f70460592980177c84e33e5', 'request_id': 'req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.722871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770e207b2f70460592980177c84e33e5', 'request_id': 'req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.746701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] The token cache is being invalidate because project 770e207b2f70460592980177c84e33e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:00.746701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.750085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e65c61eb-ef30-4b63-b979-36d8a55bf4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.751473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 910/1809] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:00 2022] DELETE /identity/v3/projects/770e207b2f70460592980177c84e33e5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:00.757313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.757608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.757882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.780172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:00.782243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.791092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.792148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.792685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.793207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.794984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.797630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.824883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 900/1810] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:00 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:00.828589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.832582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.850956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90290b19-0451-466e-b9ce-88f6194e3023 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.858515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.859504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.860326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.860754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.861991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.865409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f393c-f739-41d5-821e-e1712d63430c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.871936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:00.874985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 911/1811] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:00.876609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.878326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.890420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 901/1812] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:00.891815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.892487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.894628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.895613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607a9c-29df-4f5e-8764-fd792cc2c176 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.901730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.902286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.902569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.902872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] PATH_INFO: `/v3/projects/5ad2372a6fb340a9a2f7ae39729ae2bc` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.904259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad2372a6fb340a9a2f7ae39729ae2bc)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.906717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.914172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:00.915477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:00.926964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 902/1813] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:00.926964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.940669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf6fa-8736-44bf-89a7-b1996cf406db None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.946368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:00.947123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:00.947411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:00.947689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:00.948415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:00.950021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:00.961611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 903/1814] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:00.962483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:00.969561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad2372a6fb340a9a2f7ae39729ae2bc', 'request_id': 'req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.976347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2f7a-5d90-4c52-b937-879e82d21e12 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:00.979372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad2372a6fb340a9a2f7ae39729ae2bc', 'request_id': 'req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:00.987911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad2372a6fb340a9a2f7ae39729ae2bc', 'request_id': 'req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.012315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] The token cache is being invalidate because project 5ad2372a6fb340a9a2f7ae39729ae2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:01.013697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.015177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.018134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 912/1815] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:00 2022] DELETE /identity/v3/projects/5ad2372a6fb340a9a2f7ae39729ae2bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:01.018991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.024192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.103066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.103817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.104112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.104495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.105418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:01.105749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.109673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.134111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:01.136869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 904/1816] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:01.139166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.147717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.169460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c9ab-ede2-44a6-968a-82e5db105b9d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.177033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b6cbb-c2ae-450b-a543-45148e3bc2e8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.182718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.183872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.184267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.184621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] PATH_INFO: `/v3/projects/d26e70006c1442aaabd9c73dcdfa4191/users/45ae0b6f292646b99dfd04f577b4208a/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.197691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.198653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.198993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.199260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] PATH_INFO: `/v3/users/090f2612241b464e9409d98ebf5ae567` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.201168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=090f2612241b464e9409d98ebf5ae567)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.206587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.216009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26e70006c1442aaabd9c73dcdfa4191, user_id=45ae0b6f292646b99dfd04f577b4208a, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.219258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.254542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 913/1817] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:01 2022] PUT /identity/v3/projects/d26e70006c1442aaabd9c73dcdfa4191/users/45ae0b6f292646b99dfd04f577b4208a/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:01.256576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.268069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.309215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090f2612241b464e9409d98ebf5ae567'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.310039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090f2612241b464e9409d98ebf5ae567'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.320439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090f2612241b464e9409d98ebf5ae567'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.321195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090f2612241b464e9409d98ebf5ae567'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.337645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090f2612241b464e9409d98ebf5ae567'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.360616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 905/1818] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:01 2022] DELETE /identity/v3/users/090f2612241b464e9409d98ebf5ae567 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:01.360616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.365005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.388706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44025683-09a3-4497-af7d-7d5267a7a9db admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.457651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:01.459783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.460932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.461371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.461809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.462676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.466566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5865e1-cde3-455e-91e7-6bff37506b92 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.484331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff11f2-8455-47c1-b7e8-a140056e1ade admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.492042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.493079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.493370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.493650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] PATH_INFO: `/v3/users/e409778e13ed45c2bf5dd636e78dadb9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.495589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e409778e13ed45c2bf5dd636e78dadb9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.499126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.505889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 914/1819] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:01 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:01.507766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a927-730e-4eda-a586-49aadca57357 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.508263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a927-730e-4eda-a586-49aadca57357 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.508733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a927-730e-4eda-a586-49aadca57357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.564344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-59b7a927-730e-4eda-a586-49aadca57357 None None] MFA Rules not processed for user `45ae0b6f292646b99dfd04f577b4208a`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:01.565693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-59b7a927-730e-4eda-a586-49aadca57357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.589506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e409778e13ed45c2bf5dd636e78dadb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.590402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e409778e13ed45c2bf5dd636e78dadb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.603132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e409778e13ed45c2bf5dd636e78dadb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.605063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e409778e13ed45c2bf5dd636e78dadb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.621735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e409778e13ed45c2bf5dd636e78dadb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:01.652408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:01.672241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 906/1820] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:01 2022] DELETE /identity/v3/users/e409778e13ed45c2bf5dd636e78dadb9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:01.672241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.672241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.688755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 915/1821] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:01.690659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.691133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.691567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.715751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:01.717747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.803975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 916/1822] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:01.807525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.809425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.811406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a4fd-5482-43d8-80da-66e070167158 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.822169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.823700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.823700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.823990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.824777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.826362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437574f1-4b2d-4ab7-8b1e-173de922a78e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:01.826951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.832823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:01.834018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:01.834525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:01.835063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:01.836153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:01.839766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:01.864193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 907/1823] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:01 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:01.864193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:01.867098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:01.880828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 917/1824] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:01 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:01.882050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.031269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd1642-e15c-4b41-860e-7cb2f2312a3e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.034159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18120822-ffb0-44eb-b466-e7752d8c2fa4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.048328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:02.049497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.050283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.050576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.050855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.051701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.054500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.083534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 918/1825] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:02.084229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.102104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca08ac7-ac63-43e6-a59f-42207919640e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.120489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.121229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.121533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.121809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.122510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.124526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.144350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.145423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.145821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.146237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.158727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 919/1826] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:02 2022] POST /identity/v3/users => generated 300 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:02.159837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.171615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.171735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8cd75-ebe7-4906-bcdd-08814bde9c6e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.173072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.176780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.177699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.177989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.178265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.179041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.180806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.196395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 920/1827] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:02.198231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.209938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 908/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:02.216337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe294bc3-d9a1-4fef-b2d2-10a8ecb6ceae admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.217591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.224128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.224938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.225235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.225515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.226310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.228913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.242346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172974b1-7e2a-43e6-a536-7c6eae81f4bf service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.254535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 921/1829] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:02.256654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.257824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.258199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.258572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] PATH_INFO: `/v3/projects/2d812ff316f74213aff22d79c1902427/users/bd17c85e979945eaa2c78f50a23cb7fa/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.259524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.278545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50080d9-7204-49a5-8396-9c44dfbdcdec admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.284680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.285766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.286126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.286579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] PATH_INFO: `/v3/projects/73d533555c1d4bd29d8de0baa55b35e9/users/fa27567567654887868254dac935b732/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.293960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d812ff316f74213aff22d79c1902427, user_id=bd17c85e979945eaa2c78f50a23cb7fa, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.297618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7e1d-8cad-4ea9-999d-1aae8846bbf2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.334493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d533555c1d4bd29d8de0baa55b35e9, user_id=fa27567567654887868254dac935b732, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.337346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.344494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 909/1830] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:02 2022] PUT /identity/v3/projects/2d812ff316f74213aff22d79c1902427/users/bd17c85e979945eaa2c78f50a23cb7fa/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:02.356910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.357414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.357856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.361084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:02.373632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 922/1831] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:02 2022] PUT /identity/v3/projects/73d533555c1d4bd29d8de0baa55b35e9/users/fa27567567654887868254dac935b732/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:02.377082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.423391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] MFA Rules not processed for user `bd17c85e979945eaa2c78f50a23cb7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:02.425815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:02.524391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9285-41cf-48fa-be31-87229e2dd750 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.531941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.546833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.547855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.548288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.549475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.552828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.567461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 923/1832] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:02.572202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.585234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f166d-884b-47cd-9015-823500059e4a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.592203 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.594041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.594482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.595031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] PATH_INFO: `/v3/projects/73d533555c1d4bd29d8de0baa55b35e9/users/fa27567567654887868254dac935b732/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.598158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d533555c1d4bd29d8de0baa55b35e9, user_id=fa27567567654887868254dac935b732, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.602129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e23bc5-3f6e-4604-adf4-9bf6915fd88c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.605309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 910/1833] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:02.606511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.616598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 924/1834] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:02 2022] PUT /identity/v3/projects/73d533555c1d4bd29d8de0baa55b35e9/users/fa27567567654887868254dac935b732/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:02.623523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030d687-76e1-4af5-af1b-f6c65debcf73 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.628060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.628350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.628632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.681107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] MFA Rules not processed for user `fa27567567654887868254dac935b732`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:02.686155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:02.748835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.749527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.749817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.750126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.751152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.756635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.815465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 911/1835] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:02 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:02.820204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.842326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:02.846690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 925/1836] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:02.859181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.862149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:02.951050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d770bb-5f96-42b2-b2a8-9055b86d1354 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:02.956927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:02.958093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:02.958625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:02.960323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:02.961259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:02.964249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:02.994331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 912/1837] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:02 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:02.995520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:02.998276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.016563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6f721-1b32-4eeb-897c-8f27426451ce admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.023986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.025402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.025785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.026160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] PATH_INFO: `/v3/projects/f440924ea2f64ce79e6a3248d99c43ac` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.027655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f440924ea2f64ce79e6a3248d99c43ac)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.030012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.058630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0143-2ac3-47cd-94c6-2e04bb85e3b4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.109807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:03.145280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f440924ea2f64ce79e6a3248d99c43ac', 'request_id': 'req-8bcbec46-16b9-4841-be5f-47756f389457'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.155399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f440924ea2f64ce79e6a3248d99c43ac', 'request_id': 'req-8bcbec46-16b9-4841-be5f-47756f389457'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.160204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.161032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.161320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.161632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.161736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f440924ea2f64ce79e6a3248d99c43ac', 'request_id': 'req-8bcbec46-16b9-4841-be5f-47756f389457'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.174731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] The token cache is being invalidate because project f440924ea2f64ce79e6a3248d99c43ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:03.174731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.175437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.177301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 913/1838] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:02 2022] DELETE /identity/v3/projects/f440924ea2f64ce79e6a3248d99c43ac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:03.182450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.183903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.233608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.235124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a18c8-45c9-4536-bc40-c080a76b0256 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.245680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 926/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:03.249437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.249850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.250207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.272971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:03.274500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.281040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbec46-16b9-4841-be5f-47756f389457 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.292429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.293124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.293407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.293715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.295858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 927/1840] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:03.296672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.298321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886a805-0a5e-42bb-9afe-3f75b3f94e3e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.299687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.307732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.320544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 914/1841] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:03.324381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404202-3634-49d7-8024-7a62617e589f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.324381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404202-3634-49d7-8024-7a62617e589f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.324381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f404202-3634-49d7-8024-7a62617e589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.332573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246081-bbc7-4c0b-875f-1060651ede56 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.340338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.341379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.341664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.341942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] PATH_INFO: `/v3/projects/263300d353744eb2a17686e6416f6c5d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.343372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=263300d353744eb2a17686e6416f6c5d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.345237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.346833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8f404202-3634-49d7-8024-7a62617e589f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:03.348367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8f404202-3634-49d7-8024-7a62617e589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.356628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 915/1842] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:03.360303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f404202-3634-49d7-8024-7a62617e589f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.370059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f404202-3634-49d7-8024-7a62617e589f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.375824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.376209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.376490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.376762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] PATH_INFO: `/v3/projects/88afc4c3a045435ca3f5913677e208dc/users/0f4da7e816724712ab9f4136805ba8ed/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.380655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:03.398642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88afc4c3a045435ca3f5913677e208dc, user_id=0f4da7e816724712ab9f4136805ba8ed, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.401089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263300d353744eb2a17686e6416f6c5d', 'request_id': 'req-b578f170-3718-46df-b400-46ca53dba34b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.402610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.411151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263300d353744eb2a17686e6416f6c5d', 'request_id': 'req-b578f170-3718-46df-b400-46ca53dba34b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.424936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 916/1843] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:03 2022] PUT /identity/v3/projects/88afc4c3a045435ca3f5913677e208dc/users/0f4da7e816724712ab9f4136805ba8ed/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:03.425969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.446065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263300d353744eb2a17686e6416f6c5d', 'request_id': 'req-b578f170-3718-46df-b400-46ca53dba34b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.469607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] The token cache is being invalidate because project 263300d353744eb2a17686e6416f6c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:03.469833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.471338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.472966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 928/1844] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:03 2022] DELETE /identity/v3/projects/263300d353744eb2a17686e6416f6c5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:03.474104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.477410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.576875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118d603-8389-43ea-932d-17b6f2b488a5 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.581591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.583016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.583335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.584580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.585606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:03.586476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:03.586954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.589820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.619084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 917/1845] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:03.620199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.623386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578f170-3718-46df-b400-46ca53dba34b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.624071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.632171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.632867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.633893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.633893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.634577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.636501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.648299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 929/1846] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:03.649154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.651839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.651964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedb0d8-c8f7-4b12-82d3-48d071af46f1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.658287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.659363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.659649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.659932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] PATH_INFO: `/v3/users/0c98d34dab7c4593a42d66e41d2531f5` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.661708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c98d34dab7c4593a42d66e41d2531f5)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.663727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.683303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50a97-2d4e-444b-886d-d0a1c1746244 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.688682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:03.689360 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:03.689650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:03.689931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:03.691656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:03.694063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:03.735661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c98d34dab7c4593a42d66e41d2531f5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.736362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c98d34dab7c4593a42d66e41d2531f5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.749192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 930/1847] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:03 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:03.749192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.750434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c98d34dab7c4593a42d66e41d2531f5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.765247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c98d34dab7c4593a42d66e41d2531f5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.796899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c98d34dab7c4593a42d66e41d2531f5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:03.823530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 918/1848] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:03 2022] DELETE /identity/v3/users/0c98d34dab7c4593a42d66e41d2531f5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:03.824682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:03.826680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:03.910384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f66-173a-4c39-9831-5a7d76f6943d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:03.957933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:03.987197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ece4c-732b-4b0b-98a5-40d2c2ca9c93 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.002987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.003846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.004135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.004652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.005362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.011900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.051730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.053278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.053572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.056836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 919/1849] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:03 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:04.056975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] PATH_INFO: `/v3/projects/88afc4c3a045435ca3f5913677e208dc/users/0f4da7e816724712ab9f4136805ba8ed/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.058716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.060059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=88afc4c3a045435ca3f5913677e208dc, user_id=0f4da7e816724712ab9f4136805ba8ed, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.067665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.083752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff93210-7bbf-4788-ac2f-744e57132f53 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.108978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 931/1850] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:03 2022] PUT /identity/v3/projects/88afc4c3a045435ca3f5913677e208dc/users/0f4da7e816724712ab9f4136805ba8ed/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:04.113464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.117112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.229375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.232904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.232904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.233104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.236667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.238367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb1c50-3c97-4573-8595-0dd4ff2b1564 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.250622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16b164-9eaa-4116-bf39-4940f258cdcd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.258693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.259418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.259765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.259977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.265548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 920/1851] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:04.266440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.268656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.268964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.269247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.315069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] MFA Rules not processed for user `0f4da7e816724712ab9f4136805ba8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:04.315603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:04.317857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.407817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.410810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.436415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 932/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:04.438349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.460742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54587d9b-946b-4e5e-ba10-07cd019de12f service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.473512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.475552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.476491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.477735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.479995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.484620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc4490-643a-4908-8da6-5544d72d9de5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.501166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 921/1853] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:04.511036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.516795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 933/1854] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:04.522772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912b9e9-0211-4ccf-a215-d8242f89810e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.528137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.529265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.529727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.531061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] PATH_INFO: `/v3/projects/55378a26be4b436ca4df3716fc727fa9/users/5b89d1205a2d4bc1858ae6b58d170c74/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.550018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55378a26be4b436ca4df3716fc727fa9, user_id=5b89d1205a2d4bc1858ae6b58d170c74, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.554114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f76053-5bc6-47a9-ad89-fe39c2f3423f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.579703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 922/1855] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:04 2022] PUT /identity/v3/projects/55378a26be4b436ca4df3716fc727fa9/users/5b89d1205a2d4bc1858ae6b58d170c74/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:04.591365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.591820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.592104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.613381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524eb8f-82b8-41ad-80c1-e8e5668b0289 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.613381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524eb8f-82b8-41ad-80c1-e8e5668b0289 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.613744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524eb8f-82b8-41ad-80c1-e8e5668b0289 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.615369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 923/1856] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:43:04.623135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156c32-8571-42f0-b57c-3078431d32db None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.623461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156c32-8571-42f0-b57c-3078431d32db None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.623698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156c32-8571-42f0-b57c-3078431d32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.648954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] MFA Rules not processed for user `5b89d1205a2d4bc1858ae6b58d170c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:04.649331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.652500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-27156c32-8571-42f0-b57c-3078431d32db None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:04.653481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-27156c32-8571-42f0-b57c-3078431d32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.736257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:04.808983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 924/1857] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:04.836575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 934/1858] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:04.837028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156c32-8571-42f0-b57c-3078431d32db None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.864995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:04.867357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:04.897488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f3684-4d5b-41c4-a93a-f0dd79d9f9ce None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.911443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.912877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.914505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:04.915617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:04.942692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:04.946427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:04.981978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 935/1859] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:04.992821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156c32-8571-42f0-b57c-3078431d32db None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:04.998287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:04.999313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:04.999738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.000420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.001571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.003654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.005525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:05.016532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.032067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbca8f4-c50b-41d6-b6f6-a77411bfb6fb service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.042178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.044789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.046314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.047268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] PATH_INFO: `/v3/projects/d39fb5f3506644cebf910d43d0e6d898` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.049153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39fb5f3506644cebf910d43d0e6d898)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.055156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.089489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 925/1860] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:04 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:05.090829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.228485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39fb5f3506644cebf910d43d0e6d898', 'request_id': 'req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.239680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39fb5f3506644cebf910d43d0e6d898', 'request_id': 'req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.253608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39fb5f3506644cebf910d43d0e6d898', 'request_id': 'req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.278534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] The token cache is being invalidate because project d39fb5f3506644cebf910d43d0e6d898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:05.278534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.280075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.284212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 936/1861] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:05 2022] DELETE /identity/v3/projects/d39fb5f3506644cebf910d43d0e6d898 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:05.284611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd18127-f101-46b3-90cb-64ce9659cc57 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.287964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.291154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:05.309461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:05.382950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.384130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.384431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.384717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.385924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.388711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.406058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:05.425670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 926/1862] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:05 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:05.430333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.435409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:05.435822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6623d9-b7e8-483b-9d12-5e1f5164d6e9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.443427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.445373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.445685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.445970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] PATH_INFO: `/v3/users/1b5f30ca2a214cd4b19ab1ed5c246e0e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.447830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5f30ca2a214cd4b19ab1ed5c246e0e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.452041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.453450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd874a1-6de5-4c04-802e-45017bc7c14b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.461720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.462660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.463464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.463892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.464890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.466725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.482729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 927/1863] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:05.488947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.501447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311c87-699b-4f42-8e40-4a33a4413f0a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.507015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.508029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.508466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.508913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] PATH_INFO: `/v3/projects/1d321659427d4669a3f788d0afa379a8/users/1fd5cd0d53494c9ca8901693f0c57460/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.530774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d321659427d4669a3f788d0afa379a8, user_id=1fd5cd0d53494c9ca8901693f0c57460, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.532750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5f30ca2a214cd4b19ab1ed5c246e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.535274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.555099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5f30ca2a214cd4b19ab1ed5c246e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.555827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5f30ca2a214cd4b19ab1ed5c246e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.558675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 928/1864] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:05 2022] PUT /identity/v3/projects/1d321659427d4669a3f788d0afa379a8/users/1fd5cd0d53494c9ca8901693f0c57460/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:05.563384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.564682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5f30ca2a214cd4b19ab1ed5c246e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.576627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5f30ca2a214cd4b19ab1ed5c246e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:05.591257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 937/1865] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:05 2022] DELETE /identity/v3/users/1b5f30ca2a214cd4b19ab1ed5c246e0e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:05.645857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf544-3551-4f57-bde9-63539981b21f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.729486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.730577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.731227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.731227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.731982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.733942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efd1ec-f2ca-443a-9605-ac1b1e6215f6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.746996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 929/1866] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:05.749805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:05.751686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:05.765938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9438-703d-42da-b8c9-3e002b661b4c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:05.771801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:05.773187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.773187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.773457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] PATH_INFO: `/v3/projects/1d321659427d4669a3f788d0afa379a8/users/1fd5cd0d53494c9ca8901693f0c57460/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.775587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d321659427d4669a3f788d0afa379a8, user_id=1fd5cd0d53494c9ca8901693f0c57460, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:05.778139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:05.802884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:05.803206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:05.803488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:05.805236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 938/1867] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:05 2022] PUT /identity/v3/projects/1d321659427d4669a3f788d0afa379a8/users/1fd5cd0d53494c9ca8901693f0c57460/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:05.860711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] MFA Rules not processed for user `1fd5cd0d53494c9ca8901693f0c57460`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:05.861955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:05.945898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:05.990173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 930/1868] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:06.007904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.012188 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.041892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.043689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.107892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfce6f-9c8d-4bb2-a11e-ffabdf8cc273 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.112109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.112769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.113056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.113332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.123968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.125704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.136640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 939/1869] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:06.137073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61856-ea86-4a48-932a-16799c3c3302 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.143349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.144448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.144927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.145356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] PATH_INFO: `/v3/projects/62fff599964043359c89d82ea0cac34c` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.146882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fff599964043359c89d82ea0cac34c)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.148968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.215115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fff599964043359c89d82ea0cac34c', 'request_id': 'req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:06.228051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.232652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.242128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fff599964043359c89d82ea0cac34c', 'request_id': 'req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:06.251435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c727-16b3-477c-8b11-48723e5e4bb8 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.253747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fff599964043359c89d82ea0cac34c', 'request_id': 'req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:06.266399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:06.269542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] The token cache is being invalidate because project 62fff599964043359c89d82ea0cac34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:06.270312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:06.271891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-cbb9cf87-e22e-4fd0-8ccd-e8f61e2b939b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:06.274828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 931/1870] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:06 2022] DELETE /identity/v3/projects/62fff599964043359c89d82ea0cac34c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:06.280690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14a83-e987-424d-a26a-5fa1959c76de None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.281337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14a83-e987-424d-a26a-5fa1959c76de None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.281807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14a83-e987-424d-a26a-5fa1959c76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.306618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d1e14a83-e987-424d-a26a-5fa1959c76de None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:06.308191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d1e14a83-e987-424d-a26a-5fa1959c76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.334349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.335384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.335675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.336009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.339082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.393049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 932/1871] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:06.402137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.403061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.404158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.438663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.441240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.450344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:06.451991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:06.461757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 940/1872] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:06.474654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 933/1873] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:06.477183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.491133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a468eda-60b1-4949-a8f4-fd9f807ddefb service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.498123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.498355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.498764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.499155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.500013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:06.500617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.502585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.518996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 941/1874] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:06.522050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.548007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ac82-efa1-43c2-8f3d-ffa4b7e95d98 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.554496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.555219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.555497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.555780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.556467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.559294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.565110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:06.608135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 934/1875] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:06 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:06.610853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.633932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33068-2004-44e6-a90c-b762ccbdf439 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.760868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.761672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.762060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.762643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.763508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.765821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.795417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 942/1876] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:06 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:06.800086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.812329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a16bec-5198-43b3-9d30-4dbbc8624731 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.817108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.818008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.818308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.818644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.819421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.821044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.833069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 935/1877] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:06.837141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.848108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0e96-aae6-4a0f-9995-2e0b72e40553 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.853861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.854562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.854848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.855164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.855903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.858503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4dc9f-65e8-4bcd-b4d5-32b856fd21fa admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.869026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 943/1878] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:06.873318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:06.884123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c7dd-b860-4a37-9087-2384ccc2f57a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:06.889580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:06.890528 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.890813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.891126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] PATH_INFO: `/v3/projects/e3a2cd8ca690446281ea40f30af3f87d/users/7cb36bba802c4898811901cbfa152bae/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.910272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a2cd8ca690446281ea40f30af3f87d, user_id=7cb36bba802c4898811901cbfa152bae, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:06.913645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:06.935531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 936/1879] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:06 2022] PUT /identity/v3/projects/e3a2cd8ca690446281ea40f30af3f87d/users/7cb36bba802c4898811901cbfa152bae/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:06.956603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:06.956853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:06.958678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:06.998789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] MFA Rules not processed for user `7cb36bba802c4898811901cbfa152bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:06.999609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:07.029952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:07.101084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 944/1880] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:07.102302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.212917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49ce66-f211-4d29-b37b-c0cddece1aca admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.219818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.221037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.221990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.222539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.223368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.226256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.296754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 937/1881] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:07 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:07.304305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.326409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067c40f-affd-436f-9107-84c9ea879ed6 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.430215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.431811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.432339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.432778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.433689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.437216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.465974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 945/1882] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:07 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:07.470360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.485659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758059-c3bc-4183-9041-a2f175208499 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.491101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.491784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.492095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.492343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.493091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.495033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.512320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 938/1883] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:07.516822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.528489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cfcf-ce34-4fb8-843f-293b194780ae admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.534481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.539548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.539548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.539548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] PATH_INFO: `/v3/projects/16a49da8c1784ef0baa44997c884357d/users/33a162c7b76f416fb5e294a1833add1e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.575535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a49da8c1784ef0baa44997c884357d, user_id=33a162c7b76f416fb5e294a1833add1e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.578276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.602192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 946/1884] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:07 2022] PUT /identity/v3/projects/16a49da8c1784ef0baa44997c884357d/users/33a162c7b76f416fb5e294a1833add1e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:07.603242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.613791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65966-8b59-4eca-a182-55ff47324554 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.685298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.686518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.686968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.687792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.688542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.691306 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c2af3-e41b-4766-beb3-4b2f6a35facd admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.713676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 939/1885] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:07.715238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.726691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e31e-227f-429e-9195-79b927ce1d78 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:07.731908 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:07.734104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.734104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.734104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] PATH_INFO: `/v3/projects/16a49da8c1784ef0baa44997c884357d/users/33a162c7b76f416fb5e294a1833add1e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.735576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a49da8c1784ef0baa44997c884357d, user_id=33a162c7b76f416fb5e294a1833add1e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:07.743610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:07.755803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 947/1886] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:07 2022] PUT /identity/v3/projects/16a49da8c1784ef0baa44997c884357d/users/33a162c7b76f416fb5e294a1833add1e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:07.782083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:07.782746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:07.783313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:07.825022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] MFA Rules not processed for user `33a162c7b76f416fb5e294a1833add1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:07.826562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:07.840630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:07.978808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 940/1887] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:07.994086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:07.997273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:08.079387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753208-3ae4-4cd7-8c0f-5e7bb2be2eb0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:08.083391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:08.084256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:08.084607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:08.086268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:08.096098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:08.097740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:08.108713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 948/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:08.206470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:08.208082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:08.223951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a390-69c9-4117-bb15-b1da53828da0 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:08.228009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:08.228676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:08.228965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:08.229241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:08.317840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:08.319678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a005cc6-cdf9-4abe-ac50-f2a919dd7a02 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:08.330970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 941/1889] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:08.696515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:08.719647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:08.768090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce847d-580c-41da-9b44-4e021163245a service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:08.775105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:08.776004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:08.776289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:08.776576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] PATH_INFO: `/v3/users/7cb36bba802c4898811901cbfa152bae` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:08.778187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb36bba802c4898811901cbfa152bae)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:08.780777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:08.835646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb36bba802c4898811901cbfa152bae'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:08.849497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb36bba802c4898811901cbfa152bae'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:08.850338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb36bba802c4898811901cbfa152bae'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:08.857945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb36bba802c4898811901cbfa152bae'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:08.865720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb36bba802c4898811901cbfa152bae'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:08.873402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 949/1890] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:08 2022] DELETE /identity/v3/users/7cb36bba802c4898811901cbfa152bae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:08.878276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:08.878575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:08.878858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:08.898319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:08.900365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:08.970532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 942/1891] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:08.983414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:08.984865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:09.064340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb1a5-0350-4768-80d5-2b675435e74b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:09.068616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:09.069668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:09.069668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:09.074095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:09.093977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:09.095629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:09.106208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 950/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:09.206692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:09.208297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:09.261767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:09.268610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32393b4-6fe3-44d6-b883-5412e8a50c33 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:09.273881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:09.274559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:09.274846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:09.275157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:09.277082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:09.364702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:09.366423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:09.377963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 943/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:09.504869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:09.506838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:09.529462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd5f32-d9f3-47a4-9150-a0a06e6ce8d2 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:09.541889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:09.543016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:09.543401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:09.543688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] PATH_INFO: `/v3/projects/e3a2cd8ca690446281ea40f30af3f87d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:09.545178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a2cd8ca690446281ea40f30af3f87d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:09.548585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:09.613263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:09.637359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a2cd8ca690446281ea40f30af3f87d', 'request_id': 'req-d0027fb3-330f-4900-8c51-545b30a1d83e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.645123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a2cd8ca690446281ea40f30af3f87d', 'request_id': 'req-d0027fb3-330f-4900-8c51-545b30a1d83e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.663684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a2cd8ca690446281ea40f30af3f87d', 'request_id': 'req-d0027fb3-330f-4900-8c51-545b30a1d83e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.692135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] The token cache is being invalidate because project e3a2cd8ca690446281ea40f30af3f87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:09.692588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.695182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.698830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 951/1894] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:09 2022] DELETE /identity/v3/projects/e3a2cd8ca690446281ea40f30af3f87d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:09.703105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:09.717059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943da4f-4a18-45a8-a16c-18c12ae14871 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:09.808091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:09.810333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:09.810714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:09.811741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] PATH_INFO: `/v3/users/33a162c7b76f416fb5e294a1833add1e` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:09.814287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a162c7b76f416fb5e294a1833add1e)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:09.820744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:09.921853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a162c7b76f416fb5e294a1833add1e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.922902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a162c7b76f416fb5e294a1833add1e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.933094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a162c7b76f416fb5e294a1833add1e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.934015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a162c7b76f416fb5e294a1833add1e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.949922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f536472f-4db6-4493-9210-2d516cff346a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a162c7b76f416fb5e294a1833add1e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:09.977326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 944/1895] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:09 2022] DELETE /identity/v3/users/33a162c7b76f416fb5e294a1833add1e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:10.451921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:10.453735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:10.481303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0027fb3-330f-4900-8c51-545b30a1d83e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:10.572758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:10.575837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:10.576167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:10.576525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] PATH_INFO: `/v3/projects/16a49da8c1784ef0baa44997c884357d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:10.578160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a49da8c1784ef0baa44997c884357d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:10.580894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:10.711195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a49da8c1784ef0baa44997c884357d', 'request_id': 'req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:10.719409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a49da8c1784ef0baa44997c884357d', 'request_id': 'req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:10.727207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a49da8c1784ef0baa44997c884357d', 'request_id': 'req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:10.745595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] The token cache is being invalidate because project 16a49da8c1784ef0baa44997c884357d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:10.745790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:10.746495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f42285ea-5cb0-4f94-8d4c-5b3e8a0065c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:10.749595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 952/1896] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:10 2022] DELETE /identity/v3/projects/16a49da8c1784ef0baa44997c884357d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:10.754023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:10.755317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:10.757217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:10.775425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:10.776686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:10.792556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:10.857087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 945/1897] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:10.867990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:10.867990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:10.868340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:10.892496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:10.893673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:10.907174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 953/1898] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:10.908261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:10.924554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f133aa1-0962-454f-ab12-4bfdad0155bc None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:10.929982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:10.930875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:10.931338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:10.931805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:10.932926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:10.933250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:10.934932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:10.948626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 946/1899] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:10.952882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:10.965166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca2407-7b9c-4466-85e9-4e427cfd8b16 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:10.970330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:10.970987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:10.971282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:10.971560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:10.972759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:10.974746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.006972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 954/1900] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:10 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:11.011459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.023122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7455-0d42-4116-8f52-3182658ce2ff admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.086247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.086985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.087313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.087577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.088578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.090535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.111890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 947/1901] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:11 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:11.116740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.127801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679970d-73f7-4414-8090-c236a4f20f00 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.132712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.133544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.133830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.134109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.134843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.136598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.149168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 955/1902] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:11.153314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.164345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb6c83-b03f-482a-ac0f-924808526e96 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.169717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.170390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.170799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.171120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.171851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.173474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e2c1-5e64-4e67-9f05-edad2fd4c0d6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.183852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 948/1903] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:11.188138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.198567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2ce4-4958-47b6-8f73-1ae850c8b2e2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.203775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.204696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.205010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.205287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] PATH_INFO: `/v3/projects/29959e89b5674f44a9d2af787bc6d7c2/users/3e0d1db89bb648c8a5100db67abdaa94/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.219423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:11.222877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29959e89b5674f44a9d2af787bc6d7c2, user_id=3e0d1db89bb648c8a5100db67abdaa94, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.225959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.241661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 956/1904] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:11 2022] PUT /identity/v3/projects/29959e89b5674f44a9d2af787bc6d7c2/users/3e0d1db89bb648c8a5100db67abdaa94/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:11.253102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.253398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.253792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.280395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] MFA Rules not processed for user `3e0d1db89bb648c8a5100db67abdaa94`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:11.281614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:11.355584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 949/1905] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:11.362668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.437284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d1f63-f3b7-4a5c-a958-b24f56136f6c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.444768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.445499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.445973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.446256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.447078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.449201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.486952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 957/1906] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:11 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:11.489066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.500447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e421f16-27ec-467f-9d0e-e780788e0161 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.513633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:11.570145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.570833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.571153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.571485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.572183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.574139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.599474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 950/1907] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:11 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:11.600895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.614169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a7a13-24ea-4091-9574-a7b1332fb700 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.619685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.620467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.620809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.621121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.622050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.623667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.644274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 958/1908] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:11.648736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.660872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00187b-5a28-40e2-8ffe-80b824d1ddd8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.671953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.672985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.673381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.673728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] PATH_INFO: `/v3/projects/b48d8dd895314802b42c0349063f16c2/users/e3d2d49fdceb4923b6f71af15957f5bb/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.697537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48d8dd895314802b42c0349063f16c2, user_id=e3d2d49fdceb4923b6f71af15957f5bb, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.700323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.721521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 951/1909] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:11 2022] PUT /identity/v3/projects/b48d8dd895314802b42c0349063f16c2/users/e3d2d49fdceb4923b6f71af15957f5bb/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:11.725877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.740576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53c99-459c-4507-a146-ac646a1586d2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.808129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.808898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.809658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.809658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.810399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.812961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d8c2-56a5-4fa2-a720-370c20c0608b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.824925 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 959/1910] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:11.828610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:11.854068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a05c2-4f7c-4f94-b9fc-36579837c127 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:11.869961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:11.870945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.871230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.871634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] PATH_INFO: `/v3/projects/b48d8dd895314802b42c0349063f16c2/users/e3d2d49fdceb4923b6f71af15957f5bb/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.874810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48d8dd895314802b42c0349063f16c2, user_id=e3d2d49fdceb4923b6f71af15957f5bb, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:11.876869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:11.901769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 952/1911] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:11 2022] PUT /identity/v3/projects/b48d8dd895314802b42c0349063f16c2/users/e3d2d49fdceb4923b6f71af15957f5bb/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:11.904131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:11.904453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:11.904776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:11.944802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] MFA Rules not processed for user `e3d2d49fdceb4923b6f71af15957f5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:11.946532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.084229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:12.146110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 960/1912] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:12.214859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:12.218158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.296181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d39f0e-617b-4371-88ee-7e51e8f72a56 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:12.300420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:12.301043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:12.302122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:12.302464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:12.382493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:12.384305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:12.401224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 953/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:12.470060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:12.472013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.485197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c33a04-5b3d-4c94-88f7-86628c145da8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:12.489957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:12.490591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:12.490688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:12.490951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:12.493323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.502890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:12.504371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.548381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:12.603914 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d238183-d2b7-4320-b230-246a9a46940c service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:12.610167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:12.611328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:12.611772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:12.612211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] PATH_INFO: `/v3/users/3aaf335e3daf4a759d8e1c0cca404b18` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:12.613841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aaf335e3daf4a759d8e1c0cca404b18)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:12.616044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:12.626261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:12.629211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10676-ea23-4b24-8023-0997a2794af0 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:12.660438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 961/1914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:12.723252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aaf335e3daf4a759d8e1c0cca404b18'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:12.724376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aaf335e3daf4a759d8e1c0cca404b18'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:12.747689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aaf335e3daf4a759d8e1c0cca404b18'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:12.748836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aaf335e3daf4a759d8e1c0cca404b18'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:12.772793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aaf335e3daf4a759d8e1c0cca404b18'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:12.808480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 954/1915] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:12 2022] DELETE /identity/v3/users/3aaf335e3daf4a759d8e1c0cca404b18 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:12.813567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:12.814038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:12.814417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:12.842175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:12.844023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:12.940402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 962/1916] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:12.960420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:12.962005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:13.052442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a84c-ebd3-4b35-bcee-a92edb745045 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.060656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.061508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.061861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.062116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.078865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.081022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.098892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 955/1917] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:13.280385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.282630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:13.391610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0179ce-041c-40a4-acd6-786b91ee8ae9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.398036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4da7e816724712ab9f4136805ba8ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88afc4c3a045435ca3f5913677e208dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.398860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.399172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.399450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.400195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:13.400501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.402327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.416609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 963/1918] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:13.420787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.436209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed9fe-0594-401c-a974-9821e3fc0b5f service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.452545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4da7e816724712ab9f4136805ba8ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88afc4c3a045435ca3f5913677e208dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.454758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.455131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.455423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.456147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.458174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.514695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 956/1919] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:13 2022] POST /identity/v3/projects => generated 354 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:13.518897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.541555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69216a-563e-4857-bcb7-06201bf1ccf4 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.558625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:13.608447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.611678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:13.665313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:13.691593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4da7e816724712ab9f4136805ba8ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88afc4c3a045435ca3f5913677e208dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.692663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.693105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.693523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.694443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:13.694553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.696387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.719060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 964/1920] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:43:13.751573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c99d0-e676-4e57-b45b-0724ac2369bf tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.763661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.764489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.764696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.765041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.765320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] PATH_INFO: `/v3/projects/eebe667db35943bda1e95111613d9d12` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.766558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebe667db35943bda1e95111613d9d12)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.769943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.775562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53ae4f-bbca-4c01-94b7-43685634b9af tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:13.780523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f4da7e816724712ab9f4136805ba8ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88afc4c3a045435ca3f5913677e208dc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:13.781464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:13.781759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:13.782037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] PATH_INFO: `/v3/projects/576b316bc56942719e3244c37402a843` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:13.783301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorizing `identity:delete_project(project_id=576b316bc56942719e3244c37402a843)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:13.786353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:13.841528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576b316bc56942719e3244c37402a843', 'request_id': 'req-fc5bf068-4360-44bd-85d6-d818d9c50668'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.845006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebe667db35943bda1e95111613d9d12', 'request_id': 'req-1819e9a3-520f-4dcc-abb3-330eb388aadc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.848717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576b316bc56942719e3244c37402a843', 'request_id': 'req-fc5bf068-4360-44bd-85d6-d818d9c50668'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.854230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebe667db35943bda1e95111613d9d12', 'request_id': 'req-1819e9a3-520f-4dcc-abb3-330eb388aadc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.858305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576b316bc56942719e3244c37402a843', 'request_id': 'req-fc5bf068-4360-44bd-85d6-d818d9c50668'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.865247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebe667db35943bda1e95111613d9d12', 'request_id': 'req-1819e9a3-520f-4dcc-abb3-330eb388aadc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.881016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] The token cache is being invalidate because project eebe667db35943bda1e95111613d9d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:13.881312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.882129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.888929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] The token cache is being invalidate because project 576b316bc56942719e3244c37402a843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:13.889344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.890149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:13.895443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 957/1922] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:13 2022] DELETE /identity/v3/projects/eebe667db35943bda1e95111613d9d12 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:13.895623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 965/1922] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:13 2022] DELETE /identity/v3/projects/576b316bc56942719e3244c37402a843 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:13.896644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.900324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:13.903795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:13.910875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.038265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bf068-4360-44bd-85d6-d818d9c50668 tempest-VolumeQuotaClassesTest-1618044718 tempest-VolumeQuotaClassesTest-1618044718-project-admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:14.043379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:14.043910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.044197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.044475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] PATH_INFO: `/v3/users/45ae0b6f292646b99dfd04f577b4208a` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.046158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e9a3-520f-4dcc-abb3-330eb388aadc admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:14.053208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:14.054469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.054761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.054865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ae0b6f292646b99dfd04f577b4208a)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:14.055078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] PATH_INFO: `/v3/users/5b89d1205a2d4bc1858ae6b58d170c74` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.056418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b89d1205a2d4bc1858ae6b58d170c74)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:14.057683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:14.058702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:14.133919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:14.134280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b89d1205a2d4bc1858ae6b58d170c74'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.135087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b89d1205a2d4bc1858ae6b58d170c74'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.146640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:14.149642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b89d1205a2d4bc1858ae6b58d170c74'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.150708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b89d1205a2d4bc1858ae6b58d170c74'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.161197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ae0b6f292646b99dfd04f577b4208a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.175630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1df41707-b3ed-4c08-9963-b98fdbdf600c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b89d1205a2d4bc1858ae6b58d170c74'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.189802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ae0b6f292646b99dfd04f577b4208a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.192976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ae0b6f292646b99dfd04f577b4208a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.205010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ae0b6f292646b99dfd04f577b4208a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.207563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 958/1923] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:13 2022] DELETE /identity/v3/users/5b89d1205a2d4bc1858ae6b58d170c74 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:14.213710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.214048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.214428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.222402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ae0b6f292646b99dfd04f577b4208a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.238006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 966/1924] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:13 2022] DELETE /identity/v3/users/45ae0b6f292646b99dfd04f577b4208a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:14.253210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:14.255080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.351188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 959/1925] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:14.363704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:14.365460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.495338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e3d9-cb1f-480f-a598-907de307b74e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:14.500998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:14.502146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.502526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.503041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.514863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:14.516868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:14.517735 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7691-1fad-4dec-bdc4-27052e9b32d3 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:14.518587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.534846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 967/1926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:14.535841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7e05d-ccff-4117-b554-39708aa61bcb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:14.548903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:14.549820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.550107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.550377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] PATH_INFO: `/v3/users/bd17c85e979945eaa2c78f50a23cb7fa` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.556090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd17c85e979945eaa2c78f50a23cb7fa)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:14.558030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:14.684134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd17c85e979945eaa2c78f50a23cb7fa'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.687224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd17c85e979945eaa2c78f50a23cb7fa'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.709332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd17c85e979945eaa2c78f50a23cb7fa'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.710460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd17c85e979945eaa2c78f50a23cb7fa'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.740301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd17c85e979945eaa2c78f50a23cb7fa'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:14.773456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 960/1927] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:14 2022] DELETE /identity/v3/users/bd17c85e979945eaa2c78f50a23cb7fa => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:14.775286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.775577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.775869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.816297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:14.817575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.920880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 968/1928] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:14.937829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:14.940022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.950448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:14.952051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:14.981150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aafbed-0d00-4b73-98a3-16974bf5b678 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:14.994497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:14.995917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:14.995917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:14.995917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] PATH_INFO: `/v3/projects/d26e70006c1442aaabd9c73dcdfa4191` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:14.999205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26e70006c1442aaabd9c73dcdfa4191)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:15.001085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:15.080884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26e70006c1442aaabd9c73dcdfa4191', 'request_id': 'req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.082445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:15.092230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26e70006c1442aaabd9c73dcdfa4191', 'request_id': 'req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.095378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:15.111852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26e70006c1442aaabd9c73dcdfa4191', 'request_id': 'req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.112091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b94d97-cca5-42e1-9ad5-c2ee8e070ce6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:15.129864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] The token cache is being invalidate because project d26e70006c1442aaabd9c73dcdfa4191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:15.130165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.130838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.135529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 969/1929] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:14 2022] DELETE /identity/v3/projects/d26e70006c1442aaabd9c73dcdfa4191 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:15.136605 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:15.139864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:15.231695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:15.233940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:15.234622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:15.236264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:15.242714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:15.287771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc4ab-40d3-45b0-9b95-c11ac75d4e9d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:15.300752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:15.302614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:15.303127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:15.303652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] PATH_INFO: `/v3/users/fa27567567654887868254dac935b732` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:15.306345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa27567567654887868254dac935b732)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:15.309171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:15.378265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:15.380815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:15.386660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa27567567654887868254dac935b732'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.392957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 961/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:15.393921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:15.396523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:15.405069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa27567567654887868254dac935b732'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.406489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa27567567654887868254dac935b732'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.409795 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5614e79-8280-48f4-82a3-ef255a37945c service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:15.416100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa27567567654887868254dac935b732'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.430225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa27567567654887868254dac935b732'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.443554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 970/1931] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:15 2022] DELETE /identity/v3/users/fa27567567654887868254dac935b732 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:15.447974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:15.449907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:15.450270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:15.450622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] PATH_INFO: `/v3/projects/55378a26be4b436ca4df3716fc727fa9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:15.452174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55378a26be4b436ca4df3716fc727fa9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:15.454985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:15.527847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55378a26be4b436ca4df3716fc727fa9', 'request_id': 'req-fb19ea48-daf2-4da9-80b2-403980bae32a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.539955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55378a26be4b436ca4df3716fc727fa9', 'request_id': 'req-fb19ea48-daf2-4da9-80b2-403980bae32a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.547140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55378a26be4b436ca4df3716fc727fa9', 'request_id': 'req-fb19ea48-daf2-4da9-80b2-403980bae32a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.560116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] The token cache is being invalidate because project 55378a26be4b436ca4df3716fc727fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:15.560410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.561091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.562898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 962/1932] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:15 2022] DELETE /identity/v3/projects/55378a26be4b436ca4df3716fc727fa9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:15.568635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:15.570289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:15.655627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:15.660561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb6357-1b4e-4fc3-983a-df1bb0cc1c6e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:15.737988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:15.739730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:15.739929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:15.740530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] PATH_INFO: `/v3/users/1fd5cd0d53494c9ca8901693f0c57460` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:15.741514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd5cd0d53494c9ca8901693f0c57460)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:15.743534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:15.803969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd5cd0d53494c9ca8901693f0c57460'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.819556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd5cd0d53494c9ca8901693f0c57460'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.820545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd5cd0d53494c9ca8901693f0c57460'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.829335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd5cd0d53494c9ca8901693f0c57460'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.841131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9a551bb4-4f88-494b-8a62-1c928ac0dd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd5cd0d53494c9ca8901693f0c57460'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:15.848367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 971/1933] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:15 2022] DELETE /identity/v3/users/1fd5cd0d53494c9ca8901693f0c57460 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:16.685672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:16.687325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:16.710119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19ea48-daf2-4da9-80b2-403980bae32a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:16.766883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:16.825081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:16.826153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:16.826448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:16.826730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] PATH_INFO: `/v3/projects/1d321659427d4669a3f788d0afa379a8` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:16.828153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d321659427d4669a3f788d0afa379a8)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:16.830206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:16.888440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d321659427d4669a3f788d0afa379a8', 'request_id': 'req-7c51e37d-9305-47ac-b91d-945a71200a7a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:16.899483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d321659427d4669a3f788d0afa379a8', 'request_id': 'req-7c51e37d-9305-47ac-b91d-945a71200a7a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:16.906680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d321659427d4669a3f788d0afa379a8', 'request_id': 'req-7c51e37d-9305-47ac-b91d-945a71200a7a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:16.920978 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] The token cache is being invalidate because project 1d321659427d4669a3f788d0afa379a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:16.921353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:16.922094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7c51e37d-9305-47ac-b91d-945a71200a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:16.923858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 963/1934] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:16 2022] DELETE /identity/v3/projects/1d321659427d4669a3f788d0afa379a8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:16.929057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:16.929558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:16.929642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:16.949014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:16.950234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.022584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 972/1935] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:17.024414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.024899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.025789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.047390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:17.048651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.059181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 964/1936] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:17.063198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.074528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a36d-5d88-4823-a641-39bae5dd33b9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.080646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.081182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.081562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.081909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.083639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:17.084143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.086733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.100994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 973/1937] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:17.105490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.116198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602c64-e2df-4139-a150-2d902cc175f7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.121388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.122066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.122965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.122965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.123959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.125510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.160256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 965/1938] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:17.164815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.177806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f8daf-2dea-4816-b2e3-8db3c34a7558 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.195811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:17.250475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.251433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.251708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.252011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.252717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.254692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.275984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 974/1939] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:17.280285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.292088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732433e8-84a1-4c19-af86-9b6500d4a4b1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.296648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.297317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.297604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.297908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.298662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.300304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.311731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 966/1940] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:17.315567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.330656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71b5ab-29af-4068-8491-83b84d11743d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.336996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.337908 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.338622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.339003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.339764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.341655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.342418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.345075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.353527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 975/1941] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:17.360519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.363649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a748a-da7b-4f36-8d25-899a9e599b80 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.369163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.370321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.370678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.372254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] PATH_INFO: `/v3/projects/73d533555c1d4bd29d8de0baa55b35e9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.374147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d533555c1d4bd29d8de0baa55b35e9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.376279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.380121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea1360-5c4d-45dd-ba9c-73dd758f07aa admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.394333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.395553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.395850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.396129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] PATH_INFO: `/v3/projects/51164a58e92a4afea197721d2b12a23a/users/c3cafd997eab4c8687519383509b5d28/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.414544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51164a58e92a4afea197721d2b12a23a, user_id=c3cafd997eab4c8687519383509b5d28, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.417251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.436614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 976/1942] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:17 2022] PUT /identity/v3/projects/51164a58e92a4afea197721d2b12a23a/users/c3cafd997eab4c8687519383509b5d28/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:17.437421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.439604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.443984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d533555c1d4bd29d8de0baa55b35e9', 'request_id': 'req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.459943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d533555c1d4bd29d8de0baa55b35e9', 'request_id': 'req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.468416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d533555c1d4bd29d8de0baa55b35e9', 'request_id': 'req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.482462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] The token cache is being invalidate because project 73d533555c1d4bd29d8de0baa55b35e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:17.482892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.483776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f67c2c3e-c3b5-4c03-97cc-5cb105c8cc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.486307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 967/1943] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:17 2022] DELETE /identity/v3/projects/73d533555c1d4bd29d8de0baa55b35e9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:17.487800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597f72-e23b-42b1-9059-dcac434f9bc7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.488158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597f72-e23b-42b1-9059-dcac434f9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.488847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597f72-e23b-42b1-9059-dcac434f9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.502395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:17.512750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b938-e145-417f-8047-f7c6ab04a355 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.517576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.518455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.518737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.519043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] PATH_INFO: `/v3/projects/2d812ff316f74213aff22d79c1902427` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.520284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d812ff316f74213aff22d79c1902427)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.522249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.522541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-49597f72-e23b-42b1-9059-dcac434f9bc7 None None] MFA Rules not processed for user `c3cafd997eab4c8687519383509b5d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:17.523796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-49597f72-e23b-42b1-9059-dcac434f9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.578601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d812ff316f74213aff22d79c1902427', 'request_id': 'req-ca0866cb-7eb8-4aee-8081-72a6a91927fb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.585247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d812ff316f74213aff22d79c1902427', 'request_id': 'req-ca0866cb-7eb8-4aee-8081-72a6a91927fb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.593006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d812ff316f74213aff22d79c1902427', 'request_id': 'req-ca0866cb-7eb8-4aee-8081-72a6a91927fb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.597526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:17.600643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 968/1944] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:17.604738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.605048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.605335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.616746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] The token cache is being invalidate because project 2d812ff316f74213aff22d79c1902427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:17.617044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.617874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.620078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 977/1945] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:17 2022] DELETE /identity/v3/projects/2d812ff316f74213aff22d79c1902427 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:17.620853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.623907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.633112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:17.634412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.717699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0866cb-7eb8-4aee-8081-72a6a91927fb admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.722656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 969/1946] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:17.723665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.725340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.733465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.734170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.734457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.734734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.735500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.737478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692fad-99a8-498d-98fc-75171a1c9cc0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.738108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03801c-b15f-46e0-9ff2-a5db3ce15f40 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:17.743751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:17.744658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.744945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.745247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] PATH_INFO: `/v3/users/0f4da7e816724712ab9f4136805ba8ed` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.746609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4da7e816724712ab9f4136805ba8ed)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:17.750093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:17.774345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 978/1947] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:17.776036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:17.776398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:17.776790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:17.804629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:17.806079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.849319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4da7e816724712ab9f4136805ba8ed'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.850050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4da7e816724712ab9f4136805ba8ed'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.865985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4da7e816724712ab9f4136805ba8ed'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.867627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4da7e816724712ab9f4136805ba8ed'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.894539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4da7e816724712ab9f4136805ba8ed'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:17.954509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 970/1949] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:17 2022] DELETE /identity/v3/users/0f4da7e816724712ab9f4136805ba8ed => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:17.954731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 979/1949] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:17.955218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.955312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:17.956161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.957983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:17.990629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:18.051246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd728-6d3e-4ab8-839a-e1d7254811a9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.110437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190598-e89c-49dc-bf09-ced7f3c079eb admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.118254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.119068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.119364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.119639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.120926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.124510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.128559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:18.165805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 971/1950] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:17 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:18.166359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.173338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.174468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.174886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.175348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.184209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:18.187445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60adb11-2954-4b06-b320-42833a59fc4a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.194790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.196176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.196471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.196743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.211703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:18.212387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.226830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.254321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 972/1951] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:18.254321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.276592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37230d2-057b-4bbf-86db-97dc36513309 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.289856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.290671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.291084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.292232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.292756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.294685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.294807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.297154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.311155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 973/1952] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:18.312319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.323398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb8e4d-cd22-45c0-9a17-a70b57ab061e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.328123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 980/1953] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:18.332355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.340707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.343324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.343885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.344755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.346109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.349821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863635c-d7a7-4b6e-ace3-3a26afbe2539 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.351625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.354815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.356319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.356610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.356896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] PATH_INFO: `/v3/projects/2225234a0a2f4bba947e008f99ae08d5/users/601e10a71f6d4b1881139f7882d91e60/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.378552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2225234a0a2f4bba947e008f99ae08d5, user_id=601e10a71f6d4b1881139f7882d91e60, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.382042 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.422754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 974/1954] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:18 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:18.424731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.439092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 981/1955] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:18 2022] PUT /identity/v3/projects/2225234a0a2f4bba947e008f99ae08d5/users/601e10a71f6d4b1881139f7882d91e60/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:18.440336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.556606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd673e-a72b-4c70-b1dd-6bd034de0858 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.567962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05b96-da52-4fd5-83c5-73bd0eedd899 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.568204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.568955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.569249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.569531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.570253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.575835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.576008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.576088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.576304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.576587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.577951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.579874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.600857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 982/1956] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:18.601913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.604879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:18.620550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 975/1957] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:18 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:18.621473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.643958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472dd6-2850-4450-b4cb-ad6eee695ae4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.649755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.650667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.650939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.651223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] PATH_INFO: `/v3/projects/88afc4c3a045435ca3f5913677e208dc` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.652428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88afc4c3a045435ca3f5913677e208dc)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.654403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa78e-29e6-4747-900e-a7b330055952 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:18.654549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.673106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:18.673953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.674832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.674832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] PATH_INFO: `/v3/projects/2225234a0a2f4bba947e008f99ae08d5/users/601e10a71f6d4b1881139f7882d91e60/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.681347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2225234a0a2f4bba947e008f99ae08d5, user_id=601e10a71f6d4b1881139f7882d91e60, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:18.684611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:18.718982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 976/1958] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:18 2022] PUT /identity/v3/projects/2225234a0a2f4bba947e008f99ae08d5/users/601e10a71f6d4b1881139f7882d91e60/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:18.729023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:18.745546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88afc4c3a045435ca3f5913677e208dc', 'request_id': 'req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:18.750383 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:18.753921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88afc4c3a045435ca3f5913677e208dc', 'request_id': 'req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:18.764440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88afc4c3a045435ca3f5913677e208dc', 'request_id': 'req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:18.797400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] The token cache is being invalidate because project 88afc4c3a045435ca3f5913677e208dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:18.801304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:18.802569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-0a8d5c97-2297-43bd-8bc9-4f6cb2cfc30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:18.804081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:18.804721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 983/1959] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:18 2022] DELETE /identity/v3/projects/88afc4c3a045435ca3f5913677e208dc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:18.806494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd06cd-859d-4e5e-ba87-440295154518 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:18.808201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd06cd-859d-4e5e-ba87-440295154518 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:18.808335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd06cd-859d-4e5e-ba87-440295154518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:18.874411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ebbd06cd-859d-4e5e-ba87-440295154518 None None] MFA Rules not processed for user `601e10a71f6d4b1881139f7882d91e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:18.875820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ebbd06cd-859d-4e5e-ba87-440295154518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:18.888548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab7fd-2cd9-4c90-950a-245ae25d463e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.000308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 984/1960] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:19.001870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.002163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.002443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.002909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.003638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.003932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.004268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.005010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.006826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.021295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 977/1961] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:19.022225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.025365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.042688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:19.044031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.073805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 985/1962] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:19.073805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.073805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.087321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ae82-1e34-4085-b620-a88752927ba9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.093209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.094058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.094612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.094843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.096609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.098614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6ab07-afa6-413d-b951-f8bde15c1b64 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.116499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 986/1963] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:19.118152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.118516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.119478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.140947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:19.142287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.155423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 987/1964] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:19.155423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.158935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54fd39-12b3-4788-8270-463b651680be admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.165043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03090c-e531-4d6d-9095-c1ba0c6d0268 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.169161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.169857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.170146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.171065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.172145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.173386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.173806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.174279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] PATH_INFO: `/v3/projects/9e9342fc17344099bc57a94c9fb3f621/users/7c5fe8ddab744603a36eed36d42d359f/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.194551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.197015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.212653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 978/1965] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:19.213891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.224941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9342fc17344099bc57a94c9fb3f621, user_id=7c5fe8ddab744603a36eed36d42d359f, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.225894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca0cd5-02e7-4545-ad8e-bdc5b553eae5 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.232283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.233063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.233418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.233743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e0ec-4244-4f07-9fdc-8fc09f1596d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.233871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.234577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:19.234984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.236683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.259780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 979/1966] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:19.261210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.273719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b2f2-6a92-47ad-99de-a6f7c768ac76 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.286392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 988/1967] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:19 2022] PUT /identity/v3/projects/9e9342fc17344099bc57a94c9fb3f621/users/7c5fe8ddab744603a36eed36d42d359f/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:19.301093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.301534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.301664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.358408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.359558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.359558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.359752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.360464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.362601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.367789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:19.396052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] MFA Rules not processed for user `7c5fe8ddab744603a36eed36d42d359f`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:19.397060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 980/1968] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:19.397569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.398606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.494855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d27a4-2d09-4ca4-96cc-5a65ebaf7504 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.499903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.500684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.501143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.502143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.505320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:19.509615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 989/1969] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:19.513934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.530199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:19.601111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.602695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.613168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 981/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:19.613619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d9d4-7556-4e33-9566-dbfaaedc66fa None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.623194 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.632771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.633495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.633783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.634150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.634770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.640791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.650052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b822df-50ef-48d8-bc04-9d07c269e8cb service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.658783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.659547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.659835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.660460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.661181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.663434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.700103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 990/1971] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:19.701211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.703542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 982/1972] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:19.707538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.729406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df170-189d-45af-912a-25715b86c471 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.814696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7253722-1f0e-4c31-820b-1faac7f2096d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.827767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.828954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.829834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.830158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.830480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.832119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.832931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.833731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.844901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.846092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.847121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.849180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.869623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 991/1973] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:19.871545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.888556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 983/1974] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:19 2022] POST /identity/v3/users => generated 306 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:19.893707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.901101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cde349-5e19-4d55-8938-e8d95792e861 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.909185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.910169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.912979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.913322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.915270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b45c-98a0-4c5f-a197-be89f30ef123 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.915428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.919013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.928891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.929622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.929960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.930189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.930962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:19.932658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:19.938130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:19.947461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 992/1975] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:19.952678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.956265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 984/1976] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:19.957357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:19.968923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7e86-5266-4176-b150-98274e9880d5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.973930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dc3da-89d9-45f7-bade-5137bcfdaf85 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:19.980970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.981892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.982309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.982561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] PATH_INFO: `/v3/projects/ded6765cc6274d3eb45ab99f7a2f1617/users/94a0caf814144f46ac8a85b099eac843/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:19.985649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:19.986745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:19.987283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:19.987574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] PATH_INFO: `/v3/projects/7aed6312e3024d23bd7573268ad6a25f/users/e01b5893e30b4bcfa56a112b74a888b1/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.017899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded6765cc6274d3eb45ab99f7a2f1617, user_id=94a0caf814144f46ac8a85b099eac843, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.019642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aed6312e3024d23bd7573268ad6a25f, user_id=e01b5893e30b4bcfa56a112b74a888b1, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.020823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be3ff-5c1e-48cf-9e4b-762e91626435 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.023138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.056051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 993/1977] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:19 2022] PUT /identity/v3/projects/ded6765cc6274d3eb45ab99f7a2f1617/users/94a0caf814144f46ac8a85b099eac843/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:20.059161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.059395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.059668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.063872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 985/1978] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:19 2022] PUT /identity/v3/projects/7aed6312e3024d23bd7573268ad6a25f/users/e01b5893e30b4bcfa56a112b74a888b1/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:20.067967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:20.153967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] MFA Rules not processed for user `94a0caf814144f46ac8a85b099eac843`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:20.156320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:20.217308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ade8f-2d70-4d6c-ae9e-a868ff511f54 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:20.238154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:20.240092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.241026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.241343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.242133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.243888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.257383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 986/1979] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:20.261661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:20.271484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:20.287459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e987fcd-6027-44b6-864b-8bd550fa0141 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:20.297330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:20.297568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 994/1980] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:20.301932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.302284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.302627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] PATH_INFO: `/v3/projects/7aed6312e3024d23bd7573268ad6a25f/users/e01b5893e30b4bcfa56a112b74a888b1/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.304903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aed6312e3024d23bd7573268ad6a25f, user_id=e01b5893e30b4bcfa56a112b74a888b1, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.307869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f4866-11cd-4d83-baad-9882a41cb1ca admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.309282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:20.311214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:20.324145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 987/1981] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:20 2022] PUT /identity/v3/projects/7aed6312e3024d23bd7573268ad6a25f/users/e01b5893e30b4bcfa56a112b74a888b1/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:20.334857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.336013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.336013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.394659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] MFA Rules not processed for user `e01b5893e30b4bcfa56a112b74a888b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:20.395964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:20.408177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b5a0-6398-4508-8d2f-efc2ea5957df None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:20.476001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:20.476830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.477121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.477493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.518562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 988/1982] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:20.548034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.549639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.559256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 995/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:20.709703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:20.721405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691162a-c498-4d00-8354-57452c3857a4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:20.725931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:20.726604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.726948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.727235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.740403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.741942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:20.755720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 989/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:20.878340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:20.892271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39d224-4233-4b1f-818d-bd9a5f5a636d service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:20.901107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:20.902011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:20.902488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:20.903015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:20.998296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:20.999860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0814ce-27ae-4849-b2e1-587c4d319432 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:21.004139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:21.012798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 996/1985] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:22.658639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:22.660116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:22.695395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:22.731316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540658-8eed-4878-b1a9-e94610e159cd service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:22.735974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:22.736896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:22.737177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:22.737450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] PATH_INFO: `/v3/users/c3cafd997eab4c8687519383509b5d28` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:22.738677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cafd997eab4c8687519383509b5d28)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:22.740656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:22.797209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cafd997eab4c8687519383509b5d28'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:22.799020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cafd997eab4c8687519383509b5d28'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:22.807563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cafd997eab4c8687519383509b5d28'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:22.808343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cafd997eab4c8687519383509b5d28'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:22.821252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cafd997eab4c8687519383509b5d28'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:22.837395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 990/1986] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:22 2022] DELETE /identity/v3/users/c3cafd997eab4c8687519383509b5d28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:22.843137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:22.843592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:22.843762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:22.862665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:22.864259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:22.926192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 997/1987] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:22.936431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:22.937975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:23.005686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48437611-c839-4c77-91a1-fe856544688a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:23.011025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:23.012014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:23.012435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:23.012849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:23.027437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:23.029217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:23.042357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 991/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:23.459268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:23.460696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:23.478785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ade43-b472-411a-9ce7-c8594e7215c1 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:23.484181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:23.485295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:23.485570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:23.485989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] PATH_INFO: `/v3/projects/51164a58e92a4afea197721d2b12a23a` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:23.487417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51164a58e92a4afea197721d2b12a23a)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:23.489529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:23.552918 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51164a58e92a4afea197721d2b12a23a', 'request_id': 'req-c7baf569-eb42-4552-990e-d718f03e69e4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.559108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51164a58e92a4afea197721d2b12a23a', 'request_id': 'req-c7baf569-eb42-4552-990e-d718f03e69e4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.566138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51164a58e92a4afea197721d2b12a23a', 'request_id': 'req-c7baf569-eb42-4552-990e-d718f03e69e4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.591583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] The token cache is being invalidate because project 51164a58e92a4afea197721d2b12a23a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:23.592116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.592845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.594662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 998/1989] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:23 2022] DELETE /identity/v3/projects/51164a58e92a4afea197721d2b12a23a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:23.598630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:23.611302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1d3b3-c0c1-401b-9bd7-a9fa077cf857 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:23.682558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:23.705411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:23.706367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:23.706651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:23.706945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] PATH_INFO: `/v3/users/601e10a71f6d4b1881139f7882d91e60` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:23.708524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601e10a71f6d4b1881139f7882d91e60)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:23.710721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:23.782862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601e10a71f6d4b1881139f7882d91e60'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.784196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601e10a71f6d4b1881139f7882d91e60'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.803064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601e10a71f6d4b1881139f7882d91e60'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.804519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601e10a71f6d4b1881139f7882d91e60'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.823249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601e10a71f6d4b1881139f7882d91e60'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:23.852750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 992/1990] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:23 2022] DELETE /identity/v3/users/601e10a71f6d4b1881139f7882d91e60 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:24.152022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.153553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.168152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf569-eb42-4552-990e-d718f03e69e4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.244569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.245817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.246200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.246609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] PATH_INFO: `/v3/users/3e0d1db89bb648c8a5100db67abdaa94` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.248002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0d1db89bb648c8a5100db67abdaa94)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.250084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.278886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:24.318734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0d1db89bb648c8a5100db67abdaa94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.322182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.323911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.341363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0d1db89bb648c8a5100db67abdaa94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.342283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0d1db89bb648c8a5100db67abdaa94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.345367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a82d-455b-492c-83ce-ce8207e32498 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.364101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0d1db89bb648c8a5100db67abdaa94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.366372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.367734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.368207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.368982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] PATH_INFO: `/v3/projects/2225234a0a2f4bba947e008f99ae08d5` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.370621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2225234a0a2f4bba947e008f99ae08d5)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.372734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.374504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d495dfb1-0f8c-4836-8153-fd3262b811f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0d1db89bb648c8a5100db67abdaa94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.382765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 999/1991] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:24 2022] DELETE /identity/v3/users/3e0d1db89bb648c8a5100db67abdaa94 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:24.387612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022e69-d6b1-49d3-a2a9-6abf8f311872 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.387973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022e69-d6b1-49d3-a2a9-6abf8f311872 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.388308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022e69-d6b1-49d3-a2a9-6abf8f311872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.415130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-50022e69-d6b1-49d3-a2a9-6abf8f311872 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:24.416802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-50022e69-d6b1-49d3-a2a9-6abf8f311872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.457061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2225234a0a2f4bba947e008f99ae08d5', 'request_id': 'req-77d404fb-16e0-4279-867e-4c41d7e6dc58'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.467911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2225234a0a2f4bba947e008f99ae08d5', 'request_id': 'req-77d404fb-16e0-4279-867e-4c41d7e6dc58'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.477082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2225234a0a2f4bba947e008f99ae08d5', 'request_id': 'req-77d404fb-16e0-4279-867e-4c41d7e6dc58'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.496356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] The token cache is being invalidate because project 2225234a0a2f4bba947e008f99ae08d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:24.496647 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.497246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1000/1992] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:24.497609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:24.499554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 993/1993] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:24 2022] DELETE /identity/v3/projects/2225234a0a2f4bba947e008f99ae08d5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:24.504191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734d8b-9804-4037-be08-7f05e615b4dd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.504510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734d8b-9804-4037-be08-7f05e615b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.504963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0734d8b-9804-4037-be08-7f05e615b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.509768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.511428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.529803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f0734d8b-9804-4037-be08-7f05e615b4dd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:24.532344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f0734d8b-9804-4037-be08-7f05e615b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.589107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d404fb-16e0-4279-867e-4c41d7e6dc58 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.594151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.594834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.595152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.595431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.598515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.612314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:24.624512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1001/1994] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:24.632835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.633148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.633411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.661954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:24.663356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:24.682705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1002/1995] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:24.687239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.690806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.692575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.696662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a54a6-c04d-4e2d-9e29-d7d496e049b0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.701323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.701986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.702271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.702763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.703483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 994/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:24.703617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:24.703828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.705485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.719635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1003/1997] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:43:24.723993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.733903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a83a5d-ffad-4f20-97ba-20f24f6d3b53 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.738534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.739262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.739546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.739944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.740696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.742869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.775644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 995/1998] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:24 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:24.780273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.791790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576ce65-67a1-47d7-9b4c-40516932b5a2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.813484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:24.863183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.864063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.864414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.864748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.865538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.868297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.893882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1004/1999] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:24 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:24.898310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.909220 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744dec-cc80-4ad2-9dc2-0638b4b0d413 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.915087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.915704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.915998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.916299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.917182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.918823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.931807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 996/2000] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:24.936187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.948975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32a655-a487-446e-a436-a7a0b8e187be admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.954224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.954981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.955212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.955627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:24.956361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:24.958200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:24.970497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1005/2001] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:24.974773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:24.985587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fd00-2473-4d4f-8ee3-b48c121888e8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:24.990681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:24.992027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:24.992027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:24.992199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] PATH_INFO: `/v3/projects/dceeb942211b47aea9fce3d4e6fc9619/users/30a559f3ad2144eca650f3d02071dc09/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.009915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dceeb942211b47aea9fce3d4e6fc9619, user_id=30a559f3ad2144eca650f3d02071dc09, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.015458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961f043-35f1-43d0-a715-59ff8f1d8a41 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.038596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 997/2002] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:24 2022] PUT /identity/v3/projects/dceeb942211b47aea9fce3d4e6fc9619/users/30a559f3ad2144eca650f3d02071dc09/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:25.044122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.046140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.076047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.076345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.076745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.085558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1213de-2642-4f6f-a787-403e9fc3ddbc admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.129237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] MFA Rules not processed for user `30a559f3ad2144eca650f3d02071dc09`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:25.131527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.224882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.225587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.225868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.226143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] PATH_INFO: `/v3/projects/29959e89b5674f44a9d2af787bc6d7c2` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.227406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29959e89b5674f44a9d2af787bc6d7c2)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.229324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.276069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 998/2003] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:25.280927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.295743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06131e-f7dd-4a0c-a626-801f5f759159 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.320322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29959e89b5674f44a9d2af787bc6d7c2', 'request_id': 'req-b18e3070-46be-4a01-b7d0-799a9cfd23d2'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.327566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29959e89b5674f44a9d2af787bc6d7c2', 'request_id': 'req-b18e3070-46be-4a01-b7d0-799a9cfd23d2'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.335568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.337189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.339193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29959e89b5674f44a9d2af787bc6d7c2', 'request_id': 'req-b18e3070-46be-4a01-b7d0-799a9cfd23d2'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.340816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.341495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.342460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.346306 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.381526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] The token cache is being invalidate because project 29959e89b5674f44a9d2af787bc6d7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:25.381841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.383183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.385753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1006/2004] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:25 2022] DELETE /identity/v3/projects/29959e89b5674f44a9d2af787bc6d7c2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:25.390682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.392848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.406812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 999/2005] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:25 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:25.410709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.413196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.440264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:25.467796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:25.525371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3070-46be-4a01-b7d0-799a9cfd23d2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.534666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b754d-e81b-48ce-a083-a43201476d75 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.535040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.536694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.536994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.537371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] PATH_INFO: `/v3/users/e3d2d49fdceb4923b6f71af15957f5bb` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.539479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d2d49fdceb4923b6f71af15957f5bb)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.539686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.540423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.540713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.540993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.541547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.541824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.544121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.575963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1000/2006] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:25 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:25.575963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.575963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.598699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d274c-1f6e-452e-b595-d542dcb853d1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.605078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.606660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.606977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.607864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] PATH_INFO: `/v3/users/7c5fe8ddab744603a36eed36d42d359f` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.610501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5fe8ddab744603a36eed36d42d359f)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.613186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d2d49fdceb4923b6f71af15957f5bb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.613998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.631316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d2d49fdceb4923b6f71af15957f5bb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.633142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d2d49fdceb4923b6f71af15957f5bb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.644113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d2d49fdceb4923b6f71af15957f5bb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.664776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d2d49fdceb4923b6f71af15957f5bb'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.674852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1007/2007] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:25 2022] DELETE /identity/v3/users/e3d2d49fdceb4923b6f71af15957f5bb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:25.676291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.678266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.699880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5fe8ddab744603a36eed36d42d359f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.703158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5fe8ddab744603a36eed36d42d359f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.717183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5fe8ddab744603a36eed36d42d359f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.719591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5fe8ddab744603a36eed36d42d359f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.751899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a0b39b02-b1d5-4b51-b9bc-4554679068b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5fe8ddab744603a36eed36d42d359f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:25.760301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674f02-289c-4ac6-bd9b-965cd57905f8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.767565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.768438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.768819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.769193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.770460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.772978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.777404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1001/2008] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:25 2022] DELETE /identity/v3/users/7c5fe8ddab744603a36eed36d42d359f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:25.781280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.782229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.782964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.810682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1008/2009] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:25.812103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.815870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.822983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:25.824675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.844156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d07fa-6982-4e85-bdf4-70849e6f597a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:25.910530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:25.933233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1002/2010] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:25.935715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:25.937583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:25.937958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:25.938449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] PATH_INFO: `/v3/projects/e471da133518439c9d8d24f704510a07/users/69ef609ad1044c77bbdb85cc277a6e0e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:25.948849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:25.951166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:25.958244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e471da133518439c9d8d24f704510a07, user_id=69ef609ad1044c77bbdb85cc277a6e0e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:25.962375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:25.978987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:25.991898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1009/2011] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:25 2022] PUT /identity/v3/projects/e471da133518439c9d8d24f704510a07/users/69ef609ad1044c77bbdb85cc277a6e0e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:25.995914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.044238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91bd68-32e7-4f8d-86e1-2638176b0374 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.076594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d988-de97-46c2-9fd9-8035c138cf2b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.084841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.086150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.086150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.086609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.087545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.090106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.105489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1010/2012] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:26.106330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.108684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.121048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.122236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.122982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.123401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.133800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7f91-8c63-4c9a-9c51-e69e19cb91a0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.135665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.137301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.142018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.142959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.143278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.143510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] PATH_INFO: `/v3/projects/b48d8dd895314802b42c0349063f16c2` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.149172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48d8dd895314802b42c0349063f16c2)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.151186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.152987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1003/2013] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:26.153912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.166239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e5cd1-c146-49d9-bbd2-fc4b47f3f6d0 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.171667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.172662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.173047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.173415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] PATH_INFO: `/v3/projects/e471da133518439c9d8d24f704510a07/users/69ef609ad1044c77bbdb85cc277a6e0e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.175729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e471da133518439c9d8d24f704510a07, user_id=69ef609ad1044c77bbdb85cc277a6e0e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.178834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6f4c3-52d3-4998-ae2e-a8dbe6d1af88 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.192191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1004/2014] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:26 2022] PUT /identity/v3/projects/e471da133518439c9d8d24f704510a07/users/69ef609ad1044c77bbdb85cc277a6e0e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:26.203352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2fb-2dcc-4225-af0f-d3e8926933c6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.203641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2fb-2dcc-4225-af0f-d3e8926933c6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.203922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2fb-2dcc-4225-af0f-d3e8926933c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.230833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48d8dd895314802b42c0349063f16c2', 'request_id': 'req-e2976b07-288a-4765-aed3-23357ad2f47b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.245465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48d8dd895314802b42c0349063f16c2', 'request_id': 'req-e2976b07-288a-4765-aed3-23357ad2f47b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.255878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48d8dd895314802b42c0349063f16c2', 'request_id': 'req-e2976b07-288a-4765-aed3-23357ad2f47b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.261658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5108d2fb-2dcc-4225-af0f-d3e8926933c6 None None] MFA Rules not processed for user `69ef609ad1044c77bbdb85cc277a6e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:26.265604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5108d2fb-2dcc-4225-af0f-d3e8926933c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.272295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] The token cache is being invalidate because project b48d8dd895314802b42c0349063f16c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:26.272822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.273902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.281192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1011/2015] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:26 2022] DELETE /identity/v3/projects/b48d8dd895314802b42c0349063f16c2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:26.282344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.284771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.341889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:26.360885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2976b07-288a-4765-aed3-23357ad2f47b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.367917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.369066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.369547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.369983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] PATH_INFO: `/v3/users/94a0caf814144f46ac8a85b099eac843` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.371647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a0caf814144f46ac8a85b099eac843)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.373964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.454533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1005/2016] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:26.455709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.456898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.456898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.458883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a0caf814144f46ac8a85b099eac843'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.488407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:26.489986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.492333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a0caf814144f46ac8a85b099eac843'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.494438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a0caf814144f46ac8a85b099eac843'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.505763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1006/2017] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:26.507442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.509988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a0caf814144f46ac8a85b099eac843'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.511322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.527699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c0006193-e7b8-4123-b9ab-b72c1667aef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a0caf814144f46ac8a85b099eac843'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:26.541279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1012/2018] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:26 2022] DELETE /identity/v3/users/94a0caf814144f46ac8a85b099eac843 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:26.543621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bfb8-166b-497b-b9d4-33aafdf76b90 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.543981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bfb8-166b-497b-b9d4-33aafdf76b90 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.544267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bfb8-166b-497b-b9d4-33aafdf76b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.573053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c6b8bfb8-166b-497b-b9d4-33aafdf76b90 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:26.575073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c6b8bfb8-166b-497b-b9d4-33aafdf76b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.578057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:26.603161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d62a-d0d9-451b-a40f-df623738775b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.677943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1013/2019] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:26.682430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.682706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.683010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.701128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:26.702397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.706790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.708095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.708461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.708833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.713857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1014/2020] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:26.714005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.714085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.723946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5b64-0e46-4e80-8ad3-cd6a708811ea None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.729923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.730597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.730883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.731205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.731943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:26.732248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.733861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.750669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1015/2021] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:26.752564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.753665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.799140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.800857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.821518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1007/2022] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:26.822485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.836347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d67f1-16f4-4950-b2fc-6dffa3c7966c service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.842571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.843373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.843770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.844386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.844905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.846930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.849079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:26.853720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc88a9-c404-4eca-a22a-0d730ec2b6c4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:26.860551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:26.862076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:26.862584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:26.863435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:26.884826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1008/2023] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:26 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:26.885884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:26.887379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:26.887791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.892438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.903920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1016/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:26.905308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:26.918610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:26.952568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438122-7f41-4778-8fea-f5fbfb4f114b service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.004360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b7ecc-c2a5-480b-8f27-84865de711f7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.021152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.023601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.025923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.026314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] PATH_INFO: `/v3/projects/9e9342fc17344099bc57a94c9fb3f621` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.029481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9342fc17344099bc57a94c9fb3f621)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.036143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.068733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.070348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.071126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.071640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.079961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.101257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:27.139763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9342fc17344099bc57a94c9fb3f621', 'request_id': 'req-64217b0d-3402-473c-ada3-3364d82f903a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.152675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9342fc17344099bc57a94c9fb3f621', 'request_id': 'req-64217b0d-3402-473c-ada3-3364d82f903a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.164273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9342fc17344099bc57a94c9fb3f621', 'request_id': 'req-64217b0d-3402-473c-ada3-3364d82f903a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.186425 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] The token cache is being invalidate because project 9e9342fc17344099bc57a94c9fb3f621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:27.186788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.187519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.192131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1009/2025] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:26 2022] DELETE /identity/v3/projects/9e9342fc17344099bc57a94c9fb3f621 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:27.192131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.192831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.204012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.206167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.225723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1017/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:27.228615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.256265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd1a7-096e-42d6-a9e6-e9e2720d539b service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.390883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64217b0d-3402-473c-ada3-3364d82f903a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.408704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.409402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.409714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.410238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.411063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.413469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.462072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.463325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.463611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.463890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] PATH_INFO: `/v3/users/e01b5893e30b4bcfa56a112b74a888b1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.467705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01b5893e30b4bcfa56a112b74a888b1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.469852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.478814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1010/2027] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:27 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:27.478814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.486670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.515986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866f31b-2514-4235-943e-19bf4f142faa admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.534598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.535409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.535674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.536006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] PATH_INFO: `/v3/projects/ded6765cc6274d3eb45ab99f7a2f1617` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.537948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded6765cc6274d3eb45ab99f7a2f1617)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.540651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.584478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01b5893e30b4bcfa56a112b74a888b1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.585921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:27.609720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01b5893e30b4bcfa56a112b74a888b1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.610519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01b5893e30b4bcfa56a112b74a888b1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.631143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01b5893e30b4bcfa56a112b74a888b1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.647089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01b5893e30b4bcfa56a112b74a888b1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.661702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded6765cc6274d3eb45ab99f7a2f1617', 'request_id': 'req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.662439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1018/2028] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:27 2022] DELETE /identity/v3/users/e01b5893e30b4bcfa56a112b74a888b1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:27.665505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.677953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded6765cc6274d3eb45ab99f7a2f1617', 'request_id': 'req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.682340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.686703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded6765cc6274d3eb45ab99f7a2f1617', 'request_id': 'req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.721906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] The token cache is being invalidate because project ded6765cc6274d3eb45ab99f7a2f1617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:27.723142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.724090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-e327a37c-0e1d-45f7-bce7-9ee8bbb55141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:27.733533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1011/2029] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:27 2022] DELETE /identity/v3/projects/ded6765cc6274d3eb45ab99f7a2f1617 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:27.740702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec951-70c8-432e-9c98-738a5001ff8b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.741458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec951-70c8-432e-9c98-738a5001ff8b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.741735 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec951-70c8-432e-9c98-738a5001ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.773940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d2fec951-70c8-432e-9c98-738a5001ff8b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:27.775476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d2fec951-70c8-432e-9c98-738a5001ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.813595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=13,keystone:SELECT=82,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:27.869793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed54c-8548-4739-80c5-52973a091983 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.883796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1012/2030] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:27.892299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.892991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.893282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.893397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.893931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.894329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.894754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.895629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.896591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:27.925708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:27.928627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.930744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1019/2031] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:27.934983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.946528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:27.966955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1013/2032] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:27.975435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:27.978237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f205-5626-44a9-846f-a70e827367d3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:27.991109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:27.991932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:27.992808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:27.993433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:27.996011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:27.998843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.000726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed932-3dbf-4d69-8421-e239762afa51 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.024076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.024837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.028420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.028573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1020/2033] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:28.028666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.028666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:28.028666 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.029783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.032573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.052268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3ad5-3d84-49ed-8b55-56bb75290b21 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.058227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1014/2034] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:28.062462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.063413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.063702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.063985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] PATH_INFO: `/v3/projects/9311f9ad1d8f4a9eb7da736896ed3153/users/28f571946b48464b9c9f9d8eb5ee9430/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.064310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.081311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3066-eb7c-4ebf-8ba9-2edd935f1470 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.096399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9311f9ad1d8f4a9eb7da736896ed3153, user_id=28f571946b48464b9c9f9d8eb5ee9430, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.096640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.097336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.097617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.097960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.098722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.099393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa23ddd-718d-41ce-b857-ff238e9b8f76 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.101805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.124883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1021/2035] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:28 2022] PUT /identity/v3/projects/9311f9ad1d8f4a9eb7da736896ed3153/users/28f571946b48464b9c9f9d8eb5ee9430/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:28.137308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.137633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.137874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.180178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1015/2036] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:28.184903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.194071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] MFA Rules not processed for user `28f571946b48464b9c9f9d8eb5ee9430`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:28.195793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.290968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1022/2037] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:28.300591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0bd30-d3a0-46af-9752-eaacbd584bca admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.304398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.306797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.309187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.310067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.310508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.311023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.311924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.326395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.333604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:28.378472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1016/2038] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:28.378472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.382599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.396577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984bff4-77af-4304-a6e1-9f9583ab17db admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.396746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef699333-b5aa-4d32-919c-5d1f96d276cb None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.400403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.401151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.401490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.401659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.401810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.402682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.402977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.403259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] PATH_INFO: `/v3/projects/7aed6312e3024d23bd7573268ad6a25f` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.404448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aed6312e3024d23bd7573268ad6a25f)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.406383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.411301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.412734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.422215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1023/2039] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:28.423993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.425475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.441070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceccd6-2fb2-4ffc-be4a-a200ba182fe4 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.452230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.453351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.453704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.454046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] PATH_INFO: `/v3/users/45c80d80bae843b3abdfdfb1d54ca205` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.455400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c80d80bae843b3abdfdfb1d54ca205)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.457519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.465642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aed6312e3024d23bd7573268ad6a25f', 'request_id': 'req-56c2e284-60fd-4fd8-b947-b27829796cd1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.474354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aed6312e3024d23bd7573268ad6a25f', 'request_id': 'req-56c2e284-60fd-4fd8-b947-b27829796cd1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.480260 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aed6312e3024d23bd7573268ad6a25f', 'request_id': 'req-56c2e284-60fd-4fd8-b947-b27829796cd1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.489080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:28.494578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] The token cache is being invalidate because project 7aed6312e3024d23bd7573268ad6a25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:28.494972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.496245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.498583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1017/2040] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:28 2022] DELETE /identity/v3/projects/7aed6312e3024d23bd7573268ad6a25f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:28.499584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.501344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.512269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c80d80bae843b3abdfdfb1d54ca205'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.524721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c80d80bae843b3abdfdfb1d54ca205'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.525426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c80d80bae843b3abdfdfb1d54ca205'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.532245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c80d80bae843b3abdfdfb1d54ca205'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.540559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c80d80bae843b3abdfdfb1d54ca205'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.547336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1024/2041] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:28 2022] DELETE /identity/v3/users/45c80d80bae843b3abdfdfb1d54ca205 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:28.548193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.549545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.570561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2e284-60fd-4fd8-b947-b27829796cd1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.619567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b18db-8e79-4262-ba42-03116e62aebd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.624737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.625646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.625926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.626201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] PATH_INFO: `/v3/users/28f571946b48464b9c9f9d8eb5ee9430` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.627891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f571946b48464b9c9f9d8eb5ee9430)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.629790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.637078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.637858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.638203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.638545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.639376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.641037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5742fa-337f-4f01-a21e-cab644672457 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.651686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1018/2042] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:28.652865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.653155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.653431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.674696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:28.676307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.680187 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:28.688155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1019/2043] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:28.689266 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.690886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.702806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f571946b48464b9c9f9d8eb5ee9430'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.708554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f306-c298-47ef-9f90-03e853cc1a83 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.714052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.714944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.715330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.715650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.718365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.718365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b7664-708d-472e-bec0-af7c80aa0b7d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.723553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f571946b48464b9c9f9d8eb5ee9430'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.725425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f571946b48464b9c9f9d8eb5ee9430'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.730257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1020/2044] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:28.731755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.732239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.732805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.735126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f571946b48464b9c9f9d8eb5ee9430'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.746442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f571946b48464b9c9f9d8eb5ee9430'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.754910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1025/2045] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:28 2022] DELETE /identity/v3/users/28f571946b48464b9c9f9d8eb5ee9430 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:28.755786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.758388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:28.759780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.760166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.823832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1021/2046] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:28.824778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.826247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.840392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b4a9-f030-4807-80c1-03c7b87ae0ab admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.840596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af8b72-5532-4ea2-b9bb-d016982da085 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:28.845154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.846058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.846338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.846591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:28.846702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] PATH_INFO: `/v3/projects/a8beda52682742448f90b6777715d0a3/users/2734e4f375e4447595fad78ba6744bea/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.847507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.847835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.848122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] PATH_INFO: `/v3/projects/c3c271d8fb604693be9a295ca44f6e9b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.849309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c271d8fb604693be9a295ca44f6e9b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.851265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.862162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8beda52682742448f90b6777715d0a3, user_id=2734e4f375e4447595fad78ba6744bea, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:28.864990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5886c-c04d-4ec9-959d-dd18f1e97478 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:28.874255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:28.878452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1026/2047] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:28 2022] PUT /identity/v3/projects/a8beda52682742448f90b6777715d0a3/users/2734e4f375e4447595fad78ba6744bea/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:28.880464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be969-f426-490b-8922-4b845192687b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.880753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be969-f426-490b-8922-4b845192687b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.881030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be969-f426-490b-8922-4b845192687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:28.899487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-356be969-f426-490b-8922-4b845192687b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:28.900739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-356be969-f426-490b-8922-4b845192687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.913146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c271d8fb604693be9a295ca44f6e9b', 'request_id': 'req-c798c1e4-957f-4602-85eb-8059191b8d1b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.922239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c271d8fb604693be9a295ca44f6e9b', 'request_id': 'req-c798c1e4-957f-4602-85eb-8059191b8d1b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.933381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c271d8fb604693be9a295ca44f6e9b', 'request_id': 'req-c798c1e4-957f-4602-85eb-8059191b8d1b'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.946218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] The token cache is being invalidate because project c3c271d8fb604693be9a295ca44f6e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:28.946510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.947340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:28.949021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1022/2048] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:28 2022] DELETE /identity/v3/projects/c3c271d8fb604693be9a295ca44f6e9b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:28.950092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:28.952722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:28.971278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1027/2049] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:28.972573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:28.972904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:28.973357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.002016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] MFA Rules not processed for user `2734e4f375e4447595fad78ba6744bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:29.003265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.026467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c1e4-957f-4602-85eb-8059191b8d1b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.031838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.032685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.033037 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.033376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.034379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:29.034778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.036344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:29.037787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d05172-fbf2-49e1-9476-3f37117771b4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.058810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1023/2050] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:29.060526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.060947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.061294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.086277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:29.087653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.103428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1024/2051] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:29.103428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.105167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.112372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1028/2052] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:29.113647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.134059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb5f4-e0af-4377-97bb-6f348775c0da None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.140975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.141766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.142270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.142462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.143157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.145162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cbef9-1647-4133-87ed-28c33c4cecb7 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.176177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1029/2053] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:29.177994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.178291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.178617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.196092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a488a-d1f8-4aa0-a03c-3525082cb127 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.198403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:29.203919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.249319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.250064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.250351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.250630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.255085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:29.268260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1030/2054] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:29.269516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.272068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.327104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.328788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.336915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545099c-24b9-4744-b97d-aab2112971c9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.339582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1025/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:29.340476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.350443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.351626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bdc81-f479-4877-b2d0-907b56757857 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.352010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.352533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.353226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.357133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.357835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.358137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.358421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.359214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.361227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.386385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1026/2056] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:29.387785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.400171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84adf2-bf1a-4f2b-9460-542de2528182 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.405598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.406596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.407085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.407714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.408605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:29.409073 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.411203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.425822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1027/2057] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:29.427475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.441247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44bbf-1fc4-4c17-afa9-36207a3a8a27 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.446572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.447221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.447506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.447778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.448909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.450667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:29.451026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.460079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.462219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.468152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1028/2058] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:29.469076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.475416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1031/2059] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:29.477137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.481840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7733d68-87f0-4add-a3da-f6a01c511ef4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.486656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.487358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.487640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.487919 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.488699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.490869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.501191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4534-77f2-4960-b653-042cba5c1fc7 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.507677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.508562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.511569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.512034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.513004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.515092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.530893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1032/2060] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:29.536267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1029/2061] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:29.537988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.551329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.565502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df82de-d1fc-47c3-baf6-6b1e0600cfa3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.667881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5623-93e3-464e-a62e-3c6c425bc145 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.679490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.680193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.680485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.680768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.682307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.684906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.692128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.693337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.693824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.694303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] PATH_INFO: `/v3/projects/7a717a42041540958271c14fcbcab09b/users/bc3dc96410a84dce917822b7f6d994be/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.715613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1030/2062] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:29.721857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.724303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a717a42041540958271c14fcbcab09b, user_id=bc3dc96410a84dce917822b7f6d994be, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.728167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.746623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1033/2063] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:29 2022] PUT /identity/v3/projects/7a717a42041540958271c14fcbcab09b/users/bc3dc96410a84dce917822b7f6d994be/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:29.751387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb9935-ae08-431a-b551-d9d114d4a8f4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.757105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.759135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.785117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:29.823931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.824759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.825051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.825338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.826088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.828080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad37dbc-2400-472e-af9b-3e733f5fbcfd admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.840431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1031/2064] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:29.841391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061f-47d6-4366-9541-0aef86aae73c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.841786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.842156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.842365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.847476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:29.848438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.848764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.849339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] PATH_INFO: `/v3/projects/9311f9ad1d8f4a9eb7da736896ed3153` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.850544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9311f9ad1d8f4a9eb7da736896ed3153)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:29.852609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:29.882481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] MFA Rules not processed for user `bc3dc96410a84dce917822b7f6d994be`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:29.884378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:29.924676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9311f9ad1d8f4a9eb7da736896ed3153', 'request_id': 'req-13e8eff0-6a35-46c4-9cfb-3becd0425220'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:29.932117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9311f9ad1d8f4a9eb7da736896ed3153', 'request_id': 'req-13e8eff0-6a35-46c4-9cfb-3becd0425220'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:29.939090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9311f9ad1d8f4a9eb7da736896ed3153', 'request_id': 'req-13e8eff0-6a35-46c4-9cfb-3becd0425220'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:29.951198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:29.958208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] The token cache is being invalidate because project 9311f9ad1d8f4a9eb7da736896ed3153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:29.958875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:29.960104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-13e8eff0-6a35-46c4-9cfb-3becd0425220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:29.966763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1032/2066] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:29.966763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:29.967411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1034/2066] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:29 2022] DELETE /identity/v3/projects/9311f9ad1d8f4a9eb7da736896ed3153 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:29.974362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:29.974764 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:29.975131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:29.980114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bcce1-0869-4c64-ad75-14aea7347dda None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:29.997977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:29.999980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.039123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.039839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.040130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.040412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.041563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.043670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.054029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1033/2067] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:30.055012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.056659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.072591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1035/2068] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:30.072591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.073786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.086003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd226a3-4a17-4dab-9acc-d7bb32f66bb9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.091233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.092129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.092408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.092682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] PATH_INFO: `/v3/projects/38abcbbe7c394952ba3d00935fe03010/users/4b34508d4cc942b5a27d86ae7d4c4ef3/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.110143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38abcbbe7c394952ba3d00935fe03010, user_id=4b34508d4cc942b5a27d86ae7d4c4ef3, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.111960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:30.113982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103df3b3-5898-4069-9b70-88bc37bafff5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.116247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3f08-a019-40f9-9584-a0ae2deefd90 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.121090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.121813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.122138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.122640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.126131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.131841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1036/2069] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:30 2022] PUT /identity/v3/projects/38abcbbe7c394952ba3d00935fe03010/users/4b34508d4cc942b5a27d86ae7d4c4ef3/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:30.133105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8eb6-a011-445e-bc75-7f93c4d8057b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.133395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8eb6-a011-445e-bc75-7f93c4d8057b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.133671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe8eb6-a011-445e-bc75-7f93c4d8057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.156150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b3fe8eb6-a011-445e-bc75-7f93c4d8057b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:30.157425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b3fe8eb6-a011-445e-bc75-7f93c4d8057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.210989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.212578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.224407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1037/2070] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:30.226022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.226312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.226592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.236977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1034/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:30.238095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.254867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab489a9-c8ac-41c5-b964-d51f6b9ba647 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.260356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.264126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] MFA Rules not processed for user `4b34508d4cc942b5a27d86ae7d4c4ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:30.264365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.264365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.264365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.264571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.264648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:30.264648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.264786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.277463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1035/2072] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:30.278337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.280052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.292951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980a5-8d9e-4e70-917a-d19d68b71dc9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.297691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.298562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.298848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.299160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] PATH_INFO: `/v3/users/bc3dc96410a84dce917822b7f6d994be` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.300360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3dc96410a84dce917822b7f6d994be)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.302487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.333687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1038/2073] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:30.334646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.341548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:30.346236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b78b-d61c-437c-a0ae-6f47a65864db None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.352067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.352837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.353119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.353399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.354108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.354317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3dc96410a84dce917822b7f6d994be'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:30.355039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3dc96410a84dce917822b7f6d994be'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:30.356055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.362041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3dc96410a84dce917822b7f6d994be'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:30.362707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3dc96410a84dce917822b7f6d994be'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:30.374973 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3dc96410a84dce917822b7f6d994be'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:30.381828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1039/2074] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:30.382653 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.386956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.391839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1036/2075] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:30 2022] DELETE /identity/v3/users/bc3dc96410a84dce917822b7f6d994be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:30.392696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.397489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.459675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea75cf-548e-45ee-9358-41b53341a98b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.464064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b413-0a7b-480b-b15f-ccf2f0e5983a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.464753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.465409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.465690 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.465998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.466689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.468719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.469229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.470009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.470403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.470748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.471557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.473771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22425-54fe-442f-bdb9-9715b9802e4c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.481686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:30.498052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1037/2076] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:30.501423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1040/2077] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:30.501550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.501550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.501550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.502177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.517928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:30.519167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.569204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f91f1-b490-47b5-b7c5-b6cd3cb99a62 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.574113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.574782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.575135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.575406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.576134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.577807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.580280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1038/2078] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:30.581087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.593866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10bb69-a29a-432f-828d-0afb43f8d33a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.596756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1041/2079] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:30.597622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.599465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.606880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.607612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.607915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.608186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.608985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.611000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.633711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1039/2080] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:30.634502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.647567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615794a5-30eb-4b14-8b99-831c95345cdb admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.652347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.653011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.653300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.653577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.654770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.656778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.678159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1040/2081] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:30.679043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.690805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23023ffa-3745-4373-818c-9c106290058d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.694783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.695488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.695777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.696192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.696780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5a2a-456e-43a0-813a-9998c945ccb6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.706145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.706525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.707389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.707679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.708103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.708871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.710032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.710557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.722006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1041/2082] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:30.722329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1042/2083] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:30.723112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.726421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.733555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905d18-d795-4a34-bb47-a4414b734b52 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.737891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5fce-7315-4886-a615-4fb43bfcdbaa service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.745636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.746963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.747248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.747393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.747583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] PATH_INFO: `/v3/projects/0fd741b108424bb3ab46a339cd8da3e3/users/1fd011c96a94439dad42f13b3ee7b24e/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.748256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.748841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.749133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] PATH_INFO: `/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08/users/4ee63d30f7ba45c69004a55be6f15117/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.752448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:30.766670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd741b108424bb3ab46a339cd8da3e3, user_id=1fd011c96a94439dad42f13b3ee7b24e, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.770485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80605002-7785-4b18-838a-4c899da0bd11 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.772833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3a1ab49af64aac84c0836d2eb02a08, user_id=4ee63d30f7ba45c69004a55be6f15117, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.776434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.789477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1042/2084] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:30 2022] PUT /identity/v3/projects/0fd741b108424bb3ab46a339cd8da3e3/users/1fd011c96a94439dad42f13b3ee7b24e/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:30.802043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162ad1-7740-46ae-8405-916287156b6e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.802335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162ad1-7740-46ae-8405-916287156b6e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.802654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a162ad1-7740-46ae-8405-916287156b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.803740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1043/2085] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:30 2022] PUT /identity/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08/users/4ee63d30f7ba45c69004a55be6f15117/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:30.807954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.832763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8a162ad1-7740-46ae-8405-916287156b6e None None] MFA Rules not processed for user `1fd011c96a94439dad42f13b3ee7b24e`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:30.833998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8a162ad1-7740-46ae-8405-916287156b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:30.893421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd56cf-cb2a-4104-9f3a-cdb169a80b2c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.899982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.900732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.901022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.901318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.902204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.917269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.932541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1043/2086] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:30.936266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1044/2087] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:30.937432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:30.949028 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1bc6-d265-47b7-8280-08d2dcadbe21 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:30.954061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:30.955138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.955442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.955705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] PATH_INFO: `/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08/users/4ee63d30f7ba45c69004a55be6f15117/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.957827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3a1ab49af64aac84c0836d2eb02a08, user_id=4ee63d30f7ba45c69004a55be6f15117, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:30.961594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:30.990990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1045/2088] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:30 2022] PUT /identity/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08/users/4ee63d30f7ba45c69004a55be6f15117/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:30.991420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:30.991420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:30.991420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:30.995686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.004978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.026534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] MFA Rules not processed for user `4ee63d30f7ba45c69004a55be6f15117`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:31.028231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.034667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:31.105909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e6d5a-1ad2-4613-b98e-1182175fca88 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.110577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.111330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.111619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.111935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.137846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1044/2089] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:31.137846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.137846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.192819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.194724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.205526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1046/2090] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:31.212552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.214575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.224634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ccf1c-66b6-4e18-b2e8-a03dfb5e35e3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.231761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.232246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f6724-3b2f-44c2-92e9-946517148fa2 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.232881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.233251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.233683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] PATH_INFO: `/v3/projects/7a717a42041540958271c14fcbcab09b` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.235274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a717a42041540958271c14fcbcab09b)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.237414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.238999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.239865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.240158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.240442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.253578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.256165 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f20a7-6808-4daf-ace1-db687d0b459b service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.267516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1047/2091] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:31.305950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a717a42041540958271c14fcbcab09b', 'request_id': 'req-23716071-625f-41e5-a14d-d3a35b560dc6'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.318169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a717a42041540958271c14fcbcab09b', 'request_id': 'req-23716071-625f-41e5-a14d-d3a35b560dc6'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.327137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a717a42041540958271c14fcbcab09b', 'request_id': 'req-23716071-625f-41e5-a14d-d3a35b560dc6'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.352779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] The token cache is being invalidate because project 7a717a42041540958271c14fcbcab09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:31.352995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.353744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-23716071-625f-41e5-a14d-d3a35b560dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.358993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1045/2092] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:31 2022] DELETE /identity/v3/projects/7a717a42041540958271c14fcbcab09b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:31.361272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.361786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.361883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.382185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:31.390612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:31.393353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.508484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1048/2093] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:31.516245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.516476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.516762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.543576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:31.545721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.546167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.547674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.561393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1046/2094] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:31.564260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73258751-38bf-4df8-81a2-05575aaa4800 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.565747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.572369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.573865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.574459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.575053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] PATH_INFO: `/v3/users/30a559f3ad2144eca650f3d02071dc09` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.576624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a559f3ad2144eca650f3d02071dc09)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.579601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7934570-8a2f-4ce7-8356-83b89d0ccc27 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.580127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.585386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.586329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.586620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.586899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.587686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:31.588462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.590861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.604715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1047/2095] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:43:31.609617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.629734 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f132-037a-44cb-9b99-1432bf909733 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.638515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.639228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.639515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.639793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.640487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.642695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.648929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a559f3ad2144eca650f3d02071dc09'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.657855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:31.685823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a559f3ad2144eca650f3d02071dc09'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.686601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a559f3ad2144eca650f3d02071dc09'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.696394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1048/2096] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:31 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:31.698412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a559f3ad2144eca650f3d02071dc09'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.700766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.715045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-17ad450f-80ec-4ef6-93cf-a0d5d11b4f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a559f3ad2144eca650f3d02071dc09'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:31.724244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1049/2097] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:31 2022] DELETE /identity/v3/users/30a559f3ad2144eca650f3d02071dc09 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:31.733923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.734359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.735071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.759574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:31.760923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.798448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bebb2d-6471-4d0a-a563-5a6f1d315396 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.861624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1050/2098] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:31.873578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.875541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.915714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:31.917718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.918423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.918709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.919228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.920071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.925100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.947117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1049/2099] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:31 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:31.951069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.952832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:31.953757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8527da3-602b-43ee-8d73-e03d7e022653 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.961061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.963963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.964255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.964531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.966091 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218e83-0efe-4678-8457-e1b0786d1ee5 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:31.970893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:31.971816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:31.972241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:31.972520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] PATH_INFO: `/v3/users/4b34508d4cc942b5a27d86ae7d4c4ef3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:31.973999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b34508d4cc942b5a27d86ae7d4c4ef3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.975757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:31.976027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.977251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:31.987622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1051/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:31.988530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:31.990680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.006705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17387b2-469f-4c1f-86a7-e990cb855f72 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.012291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.012906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.013181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.013445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.014421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.016080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.028715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1052/2101] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:32.032773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.037469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b34508d4cc942b5a27d86ae7d4c4ef3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.038491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b34508d4cc942b5a27d86ae7d4c4ef3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.044505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486456c-0446-495b-b9ee-111fefb4ec4e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.047642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b34508d4cc942b5a27d86ae7d4c4ef3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.048450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b34508d4cc942b5a27d86ae7d4c4ef3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.051313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.052245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.052812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.053113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.053968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.055672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.064378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d30d37ad-f541-4817-80f5-3203eb9692d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b34508d4cc942b5a27d86ae7d4c4ef3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.066652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1053/2102] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:32.071186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.074307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.076065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:32.081046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1050/2103] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:31 2022] DELETE /identity/v3/users/4b34508d4cc942b5a27d86ae7d4c4ef3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:32.085719 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.086016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.086382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.092030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4a91-0656-42f0-8c12-8ac73e402d7f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.107851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:32.109116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.169048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.169974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.170259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.170566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] PATH_INFO: `/v3/projects/89da5abeda694329894d937f7a58f7af/users/0ef9f92286394a4492c3c62f5a5f1e35/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.186903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1051/2104] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:32.194127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89da5abeda694329894d937f7a58f7af, user_id=0ef9f92286394a4492c3c62f5a5f1e35, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.197448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b63fc-5695-4845-8c0c-2002dc532f57 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.198236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.200209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.212652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1054/2105] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:32 2022] PUT /identity/v3/projects/89da5abeda694329894d937f7a58f7af/users/0ef9f92286394a4492c3c62f5a5f1e35/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:32.224652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.224929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.225386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.264137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] MFA Rules not processed for user `0ef9f92286394a4492c3c62f5a5f1e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:32.266390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.268684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3f21-ef42-428e-8085-f799d4fcab9e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.330350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.331502 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.331979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.333088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.378395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1055/2106] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:32.378395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.378395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.398549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:32.417369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.418877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.432049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1052/2107] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:32.432880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.434667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.445592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:32.477715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a24f8-1e0a-485a-a678-af3c0d29c0a9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.485406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.487526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.487744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.488029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] PATH_INFO: `/v3/projects/dceeb942211b47aea9fce3d4e6fc9619` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.490132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dceeb942211b47aea9fce3d4e6fc9619)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.492568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.523319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3507eb6-dc8f-40b1-a4cf-8ddd9eb27068 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.533417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.534956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.534956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.534956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.545030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.546625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.567132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1053/2108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:32.578649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dceeb942211b47aea9fce3d4e6fc9619', 'request_id': 'req-f44ba28b-faeb-4e43-a63c-a1b384872cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.587578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.589901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dceeb942211b47aea9fce3d4e6fc9619', 'request_id': 'req-f44ba28b-faeb-4e43-a63c-a1b384872cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.598850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dceeb942211b47aea9fce3d4e6fc9619', 'request_id': 'req-f44ba28b-faeb-4e43-a63c-a1b384872cb4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.602717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3851c96-ca12-4ea5-a366-99cc30920881 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.613225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] The token cache is being invalidate because project dceeb942211b47aea9fce3d4e6fc9619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:32.613697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.614635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.616451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1056/2109] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:32 2022] DELETE /identity/v3/projects/dceeb942211b47aea9fce3d4e6fc9619 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:32.621012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.623247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.681134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.682150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.682539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.682818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] PATH_INFO: `/v3/users/0ef9f92286394a4492c3c62f5a5f1e35` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.684397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef9f92286394a4492c3c62f5a5f1e35)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.686733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.704109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba28b-faeb-4e43-a63c-a1b384872cb4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:32.709000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:32.709883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.710162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.710433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] PATH_INFO: `/v3/users/69ef609ad1044c77bbdb85cc277a6e0e` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.711665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ef609ad1044c77bbdb85cc277a6e0e)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:32.713945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:32.761112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef9f92286394a4492c3c62f5a5f1e35'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.761999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef9f92286394a4492c3c62f5a5f1e35'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.770781 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef9f92286394a4492c3c62f5a5f1e35'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.771574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef9f92286394a4492c3c62f5a5f1e35'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.780065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ef609ad1044c77bbdb85cc277a6e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.784528 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-0979cf17-6f18-481d-8230-c1e78b6a1126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef9f92286394a4492c3c62f5a5f1e35'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.785467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:32.797173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ef609ad1044c77bbdb85cc277a6e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.799122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ef609ad1044c77bbdb85cc277a6e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.801444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1054/2110] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:32 2022] DELETE /identity/v3/users/0ef9f92286394a4492c3c62f5a5f1e35 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:32.805702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:32.806023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:32.806301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:32.809334 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ef609ad1044c77bbdb85cc277a6e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.821386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ef609ad1044c77bbdb85cc277a6e0e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:32.826465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:32.827740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.831500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1057/2111] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:32 2022] DELETE /identity/v3/users/69ef609ad1044c77bbdb85cc277a6e0e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:32.853612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:32.881327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.882813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:32.908514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1055/2112] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:32.920638 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:32.924747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.006972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa803937-2dfb-4b29-89c0-90ac9bbfa482 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.014138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249654a4-798b-4230-9f54-ad4a349a499a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.018186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.018350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.019171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.019318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.019466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.019829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.020162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.020274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] PATH_INFO: `/v3/projects/38abcbbe7c394952ba3d00935fe03010` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.021759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=38abcbbe7c394952ba3d00935fe03010)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.024784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.032702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.035868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.049320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1056/2113] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:33.083160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38abcbbe7c394952ba3d00935fe03010', 'request_id': 'req-4102f320-f2b1-490b-8a8c-e9fc297a44ff'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.090682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38abcbbe7c394952ba3d00935fe03010', 'request_id': 'req-4102f320-f2b1-490b-8a8c-e9fc297a44ff'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.098556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38abcbbe7c394952ba3d00935fe03010', 'request_id': 'req-4102f320-f2b1-490b-8a8c-e9fc297a44ff'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.114317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] The token cache is being invalidate because project 38abcbbe7c394952ba3d00935fe03010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:33.114734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.115536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.117189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1058/2114] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:32 2022] DELETE /identity/v3/projects/38abcbbe7c394952ba3d00935fe03010 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:33.121602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.132704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608adcb-0277-4d89-9147-44fb55f88bc1 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.224802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.225970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.226468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.226683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] PATH_INFO: `/v3/users/4ee63d30f7ba45c69004a55be6f15117` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.228375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee63d30f7ba45c69004a55be6f15117)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.230410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.282180 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee63d30f7ba45c69004a55be6f15117'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.283111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee63d30f7ba45c69004a55be6f15117'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.291234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee63d30f7ba45c69004a55be6f15117'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.291905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee63d30f7ba45c69004a55be6f15117'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.297865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.299796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.313175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102f320-f2b1-490b-8a8c-e9fc297a44ff admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.318828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.319742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.320164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.321092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] PATH_INFO: `/v3/projects/e471da133518439c9d8d24f704510a07` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.322697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e471da133518439c9d8d24f704510a07)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.323651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d4ad84df-ea9d-4461-b4a2-723f438d4645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee63d30f7ba45c69004a55be6f15117'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.324698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.327911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:33.362759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1057/2115] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:33 2022] DELETE /identity/v3/users/4ee63d30f7ba45c69004a55be6f15117 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:33.384709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:33.387149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e471da133518439c9d8d24f704510a07', 'request_id': 'req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.395843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e471da133518439c9d8d24f704510a07', 'request_id': 'req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.413192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e471da133518439c9d8d24f704510a07', 'request_id': 'req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.432691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] The token cache is being invalidate because project e471da133518439c9d8d24f704510a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:33.433369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.434428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9d1739e9-d12f-4cde-b4a8-e8d4c7439be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.437267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1059/2116] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:33 2022] DELETE /identity/v3/projects/e471da133518439c9d8d24f704510a07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:33.443870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.444299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.444746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.467326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:33.468620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.548117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1058/2117] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:33.557861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.559159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.560415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.585348 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:33.586890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.596606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1060/2118] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:33.601176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.610641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.617511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e66bc-cc7e-422c-b207-54bbe5ec3fc3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.624728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.625922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.625922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.626406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.627316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:33.627637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.628496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.630183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.645830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1059/2119] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:33.648674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f5363-20ea-4a4c-b436-260568b21f36 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.652789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.658096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.658096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.658096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.658096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] PATH_INFO: `/v3/projects/89da5abeda694329894d937f7a58f7af` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.659654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89da5abeda694329894d937f7a58f7af)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.662108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.680789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455079f0-0549-40ba-b482-b5d606eaf7f7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.688034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.688751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.689034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.689354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.690048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.693092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.729092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89da5abeda694329894d937f7a58f7af', 'request_id': 'req-cffae162-2270-4087-943b-ac3876776e9c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.736702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89da5abeda694329894d937f7a58f7af', 'request_id': 'req-cffae162-2270-4087-943b-ac3876776e9c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.747531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89da5abeda694329894d937f7a58f7af', 'request_id': 'req-cffae162-2270-4087-943b-ac3876776e9c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.756845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1060/2120] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:33 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:33.760981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.791119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] The token cache is being invalidate because project 89da5abeda694329894d937f7a58f7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:33.791119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.791797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:33.793808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1061/2121] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:33 2022] DELETE /identity/v3/projects/89da5abeda694329894d937f7a58f7af => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:33.794833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.796284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.855270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4d547-b7dd-4672-a839-7c2323f3f946 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.860682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.861534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.861825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.862103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.862802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.865510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.892088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1061/2122] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:33 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:33.896726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.898966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:33.917799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb5287-59de-4099-8983-8303bb98a022 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.923178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.924079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.924592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.925129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.925762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae162-2270-4087-943b-ac3876776e9c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.926861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.928990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.931628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.932548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.932904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.933249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] PATH_INFO: `/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.936499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3a1ab49af64aac84c0836d2eb02a08)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.942510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1062/2123] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:33.943361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.946532 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:33.959380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd80ba-f2ca-4552-b8ed-1193aaf9474b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:33.966866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:33.967924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:33.968393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:33.968977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:33.969945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:33.972298 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:33.993819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1063/2124] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:33.995504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.009239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a783108-9bc6-433d-8dfe-4d04c8cbb8b6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.015226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3a1ab49af64aac84c0836d2eb02a08', 'request_id': 'req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:34.020770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.022617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3a1ab49af64aac84c0836d2eb02a08', 'request_id': 'req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:34.031627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3a1ab49af64aac84c0836d2eb02a08', 'request_id': 'req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:34.037233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.052031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] The token cache is being invalidate because project ec3a1ab49af64aac84c0836d2eb02a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:34.053553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:34.054347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f5b699ae-d106-4f3c-bcf7-a6f9b852da48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:34.056144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1062/2125] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:33 2022] DELETE /identity/v3/projects/ec3a1ab49af64aac84c0836d2eb02a08 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:34.061035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487f31-dd42-4ccc-b14c-cb0885562c25 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.061411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487f31-dd42-4ccc-b14c-cb0885562c25 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.061691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487f31-dd42-4ccc-b14c-cb0885562c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.080633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.081597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.081822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0d487f31-dd42-4ccc-b14c-cb0885562c25 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:34.081939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.082176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] PATH_INFO: `/v3/projects/65903db013f74d739cc58b2fa66c18a4/users/63f758a9376841feacd1786ac3885e39/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.083759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0d487f31-dd42-4ccc-b14c-cb0885562c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.092437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1063/2126] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:34.102261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65903db013f74d739cc58b2fa66c18a4, user_id=63f758a9376841feacd1786ac3885e39, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.102455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.102636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.103005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.105164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafef5b-9c2e-43cc-b18e-6f331f393253 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.119108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1064/2127] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:33 2022] PUT /identity/v3/projects/65903db013f74d739cc58b2fa66c18a4/users/63f758a9376841feacd1786ac3885e39/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:34.121805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:34.123063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.130649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.131107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.131390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.159202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] MFA Rules not processed for user `63f758a9376841feacd1786ac3885e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:34.160628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.183540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1064/2128] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:34.187884 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.196743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbd77-28bf-4cd9-b1d8-724ba515ec41 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.201916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.202946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.203243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.203767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.204516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:34.204826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.206444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.219530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1065/2129] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:43:34.224510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.229977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1065/2130] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:34.235417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.235633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5207-66f2-4798-bbfd-fb544e04577b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.237117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.240885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.241826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.242314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.242769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.244038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.245723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.251926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9debcf7-e365-40e6-9f92-0de0893bb0e9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.259550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.260658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.261171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.261558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.262811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.266082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.292096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1066/2131] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:34.298079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.315382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1066/2132] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:34.316753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.379046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c929-a746-4e7d-b0da-aaabf78ceca1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.400225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496051b-47d1-4002-97e9-2fdd7b330d17 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.405445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.406177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.406509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.406843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.407555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.409559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.435908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1067/2133] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:34.436891 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.440449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.447250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.451286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.451429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f4891-62d6-4903-b765-21df0c91603e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.451978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.452513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.452912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.453970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.456051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.457356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.458015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.458295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.458570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.459342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.460964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.472057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1068/2134] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:34.476337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.478022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1067/2135] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:34.482620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.487247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e8d5e-6933-442d-848c-8bd2b7b960bd admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.491996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.492905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.493023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761df8-01f9-4d4c-9012-a1a755573b1a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.493190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.493488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] PATH_INFO: `/v3/projects/99d8c14ce31e45c6925e3cd37ae47168/users/d0f543ec2b5b46abab6f1279007f46ab/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.497796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.498457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.498743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.499060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.499889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.501508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.508959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d8c14ce31e45c6925e3cd37ae47168, user_id=d0f543ec2b5b46abab6f1279007f46ab, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.511669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.514859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1068/2136] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:34.516161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.525008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1069/2137] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:34 2022] PUT /identity/v3/projects/99d8c14ce31e45c6925e3cd37ae47168/users/d0f543ec2b5b46abab6f1279007f46ab/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:34.526772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb8b3-f5e3-435a-9a39-89e776effb3e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.529147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.590245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.590833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.591144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.591415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.592145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.593751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.604071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698229-22cd-4976-a743-ffc2e6671688 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.604815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1069/2138] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:34.609368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.610284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.610988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.611272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.611547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.612728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.613961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.619323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48173323-a2a4-4f82-a8a5-51bb8f0dfebd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.624261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.625393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1070/2139] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:34.626385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.626705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.627354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] PATH_INFO: `/v3/projects/d690ba7df3a7400faa02b8da1fe3dee4/users/8b9e84e764ed48128b6161037e5132c2/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.632076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.642553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372860f9-485f-4bba-9f0c-a273c1f190e6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.646418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d690ba7df3a7400faa02b8da1fe3dee4, user_id=8b9e84e764ed48128b6161037e5132c2, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.647997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.648982 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.649384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.649726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] PATH_INFO: `/v3/projects/99d8c14ce31e45c6925e3cd37ae47168/users/d0f543ec2b5b46abab6f1279007f46ab/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.650141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b628-8abf-440e-bd91-419ff588b74c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.651757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d8c14ce31e45c6925e3cd37ae47168, user_id=d0f543ec2b5b46abab6f1279007f46ab, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.654518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2e957-edc9-4ee2-be71-2cb40cea3cf7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.667456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1070/2140] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:34 2022] PUT /identity/v3/projects/d690ba7df3a7400faa02b8da1fe3dee4/users/8b9e84e764ed48128b6161037e5132c2/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:34.670779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1071/2141] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:34 2022] PUT /identity/v3/projects/99d8c14ce31e45c6925e3cd37ae47168/users/d0f543ec2b5b46abab6f1279007f46ab/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:34.672997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.673314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.673592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.680837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.681135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.681420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.695237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:34.696465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.709041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] MFA Rules not processed for user `d0f543ec2b5b46abab6f1279007f46ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:34.710265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.758262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1071/2142] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:34.770548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.772006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.781986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1072/2143] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:34.815804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.817768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:34.819981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.839595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c06c7-04ac-446b-a9c7-394157c99d5c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.843245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.844053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.844311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.844583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.858464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.860754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.876934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1072/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:34.881035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:34.900765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6da20-26e9-462d-8483-32f286f112a6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.905375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.907692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.908188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.908538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.920085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.921759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7893e2-766d-4828-a3bf-d92a92aaf154 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:34.932572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1073/2145] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:34.965161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:34.976639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081a9d-e744-455d-ab83-e8f9cedbe52d service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:34.982349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:34.983941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:34.984326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:34.984675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] PATH_INFO: `/v3/users/63f758a9376841feacd1786ac3885e39` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:34.986290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f758a9376841feacd1786ac3885e39)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:34.988468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:35.049404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f758a9376841feacd1786ac3885e39'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.066205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f758a9376841feacd1786ac3885e39'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.067401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f758a9376841feacd1786ac3885e39'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.076876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f758a9376841feacd1786ac3885e39'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.086180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f758a9376841feacd1786ac3885e39'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.095818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1073/2146] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:34 2022] DELETE /identity/v3/users/63f758a9376841feacd1786ac3885e39 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:35.101481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64253f-1072-4869-a7ca-42ee85951978 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:35.103268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64253f-1072-4869-a7ca-42ee85951978 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:35.103618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64253f-1072-4869-a7ca-42ee85951978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:35.135801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-fa64253f-1072-4869-a7ca-42ee85951978 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:35.137038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fa64253f-1072-4869-a7ca-42ee85951978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:35.238555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1074/2147] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:35.248920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:35.250595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:35.320713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58427-daa0-4a56-8f52-3acd047e6c5c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:35.324680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:35.325311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:35.325654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:35.326043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:35.336738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:35.339173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:35.353066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1074/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:35.816726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:35.817292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:35.817639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:35.855151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] MFA Rules not processed for user `8b9e84e764ed48128b6161037e5132c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:35.856175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:35.856643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:35.858645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:35.883423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493efc-d0ed-4849-ac73-f5ada0356560 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:35.889033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:35.896299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:35.896820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:35.897140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] PATH_INFO: `/v3/projects/65903db013f74d739cc58b2fa66c18a4` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:35.903082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65903db013f74d739cc58b2fa66c18a4)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:35.905075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:35.953687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1075/2149] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:35.958465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:35.960343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:35.963625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65903db013f74d739cc58b2fa66c18a4', 'request_id': 'req-3d991a42-6cad-4d30-a70e-2188328e30a3'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.970469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65903db013f74d739cc58b2fa66c18a4', 'request_id': 'req-3d991a42-6cad-4d30-a70e-2188328e30a3'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.972704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:35.977264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc17b7-140b-421d-9bec-441d3cb14b6a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:35.979969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65903db013f74d739cc58b2fa66c18a4', 'request_id': 'req-3d991a42-6cad-4d30-a70e-2188328e30a3'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.998586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] The token cache is being invalidate because project 65903db013f74d739cc58b2fa66c18a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:35.998899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:35.999839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.001741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1075/2150] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:35 2022] DELETE /identity/v3/projects/65903db013f74d739cc58b2fa66c18a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:36.005909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.007666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.042506 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.043237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.043520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.043790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.044485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.046563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.061036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:36.073048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991a42-6cad-4d30-a70e-2188328e30a3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.079010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1076/2151] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:36.079937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.080749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.081524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.081633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.081904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.082256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] PATH_INFO: `/v3/users/d0f543ec2b5b46abab6f1279007f46ab` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.083499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f543ec2b5b46abab6f1279007f46ab)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.085423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.134035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f543ec2b5b46abab6f1279007f46ab'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.145438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac3e7-17d7-4587-bea7-f426a9ec7900 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.147089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f543ec2b5b46abab6f1279007f46ab'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.147814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f543ec2b5b46abab6f1279007f46ab'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.150164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.150830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.151254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.151530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.152209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.154139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.155214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f543ec2b5b46abab6f1279007f46ab'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.164170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f543ec2b5b46abab6f1279007f46ab'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.172497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1076/2152] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:36 2022] DELETE /identity/v3/users/d0f543ec2b5b46abab6f1279007f46ab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:36.177055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1077/2153] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:36 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:36.178044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.179550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.278542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeeaadd-9ec7-4ba1-838f-cf920f606a73 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.284278 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.285001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.285517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.285814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.286593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.288318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.290055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:36.300914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1077/2154] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:36.305378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.331140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294da18-ab30-47cf-ae68-fdb67de0496c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.355704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.356627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.356917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.357198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] PATH_INFO: `/v3/projects/86595172e66444599edeea74546752c9/users/13c38acf35ce491092fddebf290a8cb9/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.381636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86595172e66444599edeea74546752c9, user_id=13c38acf35ce491092fddebf290a8cb9, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.385177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.401742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1078/2155] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:36 2022] PUT /identity/v3/projects/86595172e66444599edeea74546752c9/users/13c38acf35ce491092fddebf290a8cb9/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:36.405492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.420904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412edbe-a562-4b97-a9e7-c8cbe3f5cdcf admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.491310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.492129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.492129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.492321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.493058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.494728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.507244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1078/2156] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:36.511139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.527047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba719dd-5b31-4b8b-9c05-30b5a40cad68 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.532744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.533694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.534112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.534536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] PATH_INFO: `/v3/projects/86595172e66444599edeea74546752c9/users/13c38acf35ce491092fddebf290a8cb9/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.536684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86595172e66444599edeea74546752c9, user_id=13c38acf35ce491092fddebf290a8cb9, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.542237 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.542447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.544413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.555315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1079/2157] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:36 2022] PUT /identity/v3/projects/86595172e66444599edeea74546752c9/users/13c38acf35ce491092fddebf290a8cb9/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:36.571158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc4d2c-8708-4b15-b4b8-b5123ef68bd8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.621741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.623924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.651285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.652421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.652716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.653001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] PATH_INFO: `/v3/projects/99d8c14ce31e45c6925e3cd37ae47168` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.654520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d8c14ce31e45c6925e3cd37ae47168)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.657244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.709212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b185ff-0e42-47f8-b9ed-6442bd800d57 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.716762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d8c14ce31e45c6925e3cd37ae47168', 'request_id': 'req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.723620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d8c14ce31e45c6925e3cd37ae47168', 'request_id': 'req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.729982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d8c14ce31e45c6925e3cd37ae47168', 'request_id': 'req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.745391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] The token cache is being invalidate because project 99d8c14ce31e45c6925e3cd37ae47168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:36.745738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.746453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f907d293-9f2e-4f7f-a8e5-bce9e2c3fb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.748395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1079/2158] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:36 2022] DELETE /identity/v3/projects/99d8c14ce31e45c6925e3cd37ae47168 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:36.753284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bf649-22f4-4f32-a092-6040be7c6335 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.753741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bf649-22f4-4f32-a092-6040be7c6335 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.754088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bf649-22f4-4f32-a092-6040be7c6335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.773632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a16bf649-22f4-4f32-a092-6040be7c6335 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:36.774948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a16bf649-22f4-4f32-a092-6040be7c6335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.781747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:36.791021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.791918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.792448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.793057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] PATH_INFO: `/v3/users/1fd011c96a94439dad42f13b3ee7b24e` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.794517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:36.795283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd011c96a94439dad42f13b3ee7b24e)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.797518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.849003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1080/2159] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:36.856856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.857810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.857810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.862033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd011c96a94439dad42f13b3ee7b24e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.863052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd011c96a94439dad42f13b3ee7b24e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.874238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd011c96a94439dad42f13b3ee7b24e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.875123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd011c96a94439dad42f13b3ee7b24e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.877114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:36.878663 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.890895 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1081/2160] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:36.895520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.897512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0f270f-a7fc-4f2f-b293-4c50b5e80427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd011c96a94439dad42f13b3ee7b24e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:36.911547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4081-ffc2-426e-b3bc-06158a762156 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:36.918349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1080/2161] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:36 2022] DELETE /identity/v3/users/1fd011c96a94439dad42f13b3ee7b24e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:36.923389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:36.924100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.924250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:36.924547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.924852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:36.924979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.925398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:36.926025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:36.926025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:36.927968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:36.950119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1082/2162] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:43:36.951322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:36.951599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:36.952933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:36.962713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ee47-0033-4a01-9705-7b5c6d96af8a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.036507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1081/2163] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:37.039592 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.040344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.040675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.041178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.041934 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.043983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.045822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.048300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.092039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1083/2164] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:36 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:37.096142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.123269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1613e47-e9b5-4fe4-af37-91de9a951cf8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.159117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:37.171175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5d711-6f1a-41c2-a80e-d28e1abbb421 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.177093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.177825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.178105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.178434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.179599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.181184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.193388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.194156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.194542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.194697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.207958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1084/2165] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:37.208141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.208141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.209363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.218125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1082/2166] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:37.221267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96231-6f7a-4a4d-90ef-0481452f657e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.227833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.228618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.228952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.229497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.230316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.232076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.252257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1085/2167] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:37.256423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.268620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c648-7a1c-4492-97c7-4f59b2c1428c service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.274036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.274718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.275076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.275355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.276094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.277791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888aba8-14dc-4529-9fcb-984192722beb admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.294437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1083/2168] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:37.296850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.314755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11678441-b0d9-4cc2-84fc-220c6a984f6b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.321533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.323101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.323416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.323738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] PATH_INFO: `/v3/projects/ddf5a99f5a594f4ab68d16e0851a7a39/users/4037a56111ba4c1b88945b93fe49e9ec/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.327715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:37.329199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128fc-c86a-4d2d-a60b-c9f2b874a9c8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.329520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128fc-c86a-4d2d-a60b-c9f2b874a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.329859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223128fc-c86a-4d2d-a60b-c9f2b874a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.352193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf5a99f5a594f4ab68d16e0851a7a39, user_id=4037a56111ba4c1b88945b93fe49e9ec, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.356144 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00466e23-4723-4d62-99cf-c795ecbaa0a6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.368162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-223128fc-c86a-4d2d-a60b-c9f2b874a9c8 None None] MFA Rules not processed for user `13c38acf35ce491092fddebf290a8cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:37.369241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-223128fc-c86a-4d2d-a60b-c9f2b874a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.376975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1086/2169] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:37 2022] PUT /identity/v3/projects/ddf5a99f5a594f4ab68d16e0851a7a39/users/4037a56111ba4c1b88945b93fe49e9ec/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:37.391890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.392202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.392452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.424312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] MFA Rules not processed for user `4037a56111ba4c1b88945b93fe49e9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:37.425544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.502635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1084/2170] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:37.514027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.514767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.514899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.552732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] MFA Rules not processed for user `8b9e84e764ed48128b6161037e5132c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:37.553984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.555297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1087/2171] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:37.570608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.682481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1085/2172] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:37.683921 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.685816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.709476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915f0f-f1df-478c-a61b-a131dd5e1ee2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.715423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.716202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.716648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.716983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.717727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.720186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.744744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:37.756370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1088/2173] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:37.757343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.760289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.763568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd24c-092f-48e4-892a-b12fe358397c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.829705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:37.834544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.835362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.835686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.835963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] PATH_INFO: `/v3/projects/0fd741b108424bb3ab46a339cd8da3e3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.837868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd741b108424bb3ab46a339cd8da3e3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.840380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.852616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574db575-4da8-4c15-8a9f-6db4d00ca4af admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:37.859667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:37.860425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.860765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.860924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.863216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.905415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd741b108424bb3ab46a339cd8da3e3', 'request_id': 'req-d846ccd2-ab32-44eb-b2a0-ac6586d77976'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:37.918486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd741b108424bb3ab46a339cd8da3e3', 'request_id': 'req-d846ccd2-ab32-44eb-b2a0-ac6586d77976'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:37.935956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd741b108424bb3ab46a339cd8da3e3', 'request_id': 'req-d846ccd2-ab32-44eb-b2a0-ac6586d77976'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:37.948951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] The token cache is being invalidate because project 0fd741b108424bb3ab46a339cd8da3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:37.949251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:37.949972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:37.950087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:37.951909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff17f2-8908-445c-b155-0334394b785f service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:37.952027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1086/2174] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:37 2022] DELETE /identity/v3/projects/0fd741b108424bb3ab46a339cd8da3e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:37.952756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:37.954267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:37.968674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1089/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:37.970898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6077-2646-42bd-a8a4-e4cc2d0147e7 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:37.971213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6077-2646-42bd-a8a4-e4cc2d0147e7 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:37.971544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6077-2646-42bd-a8a4-e4cc2d0147e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:37.999790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-60bb6077-2646-42bd-a8a4-e4cc2d0147e7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:38.001082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-60bb6077-2646-42bd-a8a4-e4cc2d0147e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.035101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846ccd2-ab32-44eb-b2a0-ac6586d77976 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.041223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.042770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.043167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.043496 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.044207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.047118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.074850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1087/2176] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:38.079067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.089169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1090/2177] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:38.093861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655ce8-db6c-421b-88b2-0ba7ce30c3d2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.097812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.098101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.098383 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.102522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.103388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.103771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.104119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.104861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.107751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.120380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1088/2178] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:38.120586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:38.121922 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.124628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.134458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1091/2179] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:38.135482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464681e6-fa03-4afc-8e58-442e39a6fff2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.139471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.142060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.143794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.143794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.143794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] PATH_INFO: `/v3/projects/dd3ff36383bb400d927c31339a864f5e/users/894ed5b4f1d4419c8601f01d0a010e29/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.148744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:38.152014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538d8cd-68a2-487c-aa29-9cfb10e892c3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.157741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.158632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.158969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.159851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.160702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:38.161019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.163281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.169021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3ff36383bb400d927c31339a864f5e, user_id=894ed5b4f1d4419c8601f01d0a010e29, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.172211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.178759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1092/2180] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:38.184046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.187807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1089/2181] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:38 2022] PUT /identity/v3/projects/dd3ff36383bb400d927c31339a864f5e/users/894ed5b4f1d4419c8601f01d0a010e29/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:38.192684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.195652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550be3e-c115-4e19-b1d0-ffe3850f04b3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.265809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.266525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.266811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.267111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.267841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.268501 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2ab2-b030-45cd-8fe2-ba2724e9b36a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.270072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.275213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.275891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.276172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.276489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.277163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.279101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.293163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1090/2182] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:38.297830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.298380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:38.309475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1093/2183] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:38 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:38.310878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.311541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e75d-56e0-4041-86a1-c6517b5881ae admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.379759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b5cdc-0487-45f0-a3bc-b5fbbc8ed288 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.382466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.383831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.384274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.384687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] PATH_INFO: `/v3/projects/dd3ff36383bb400d927c31339a864f5e/users/894ed5b4f1d4419c8601f01d0a010e29/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.385365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.386124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.386476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.388893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.389109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3ff36383bb400d927c31339a864f5e, user_id=894ed5b4f1d4419c8601f01d0a010e29, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.389251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.390182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.391104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1017a0c-fa46-4eeb-a4b5-38bcb0f90dbc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.405051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1091/2184] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:38 2022] PUT /identity/v3/projects/dd3ff36383bb400d927c31339a864f5e/users/894ed5b4f1d4419c8601f01d0a010e29/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:38.416055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.416461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.416850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.420293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1094/2185] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:38 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:38.421101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.434885 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf048c-79d6-4a5a-8b75-230c92cf41a4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.451949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] MFA Rules not processed for user `894ed5b4f1d4419c8601f01d0a010e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:38.453617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.501359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.502143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.502498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.502846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.503684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.505454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.519179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1095/2186] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:38.520621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.531311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cb49-1e96-4709-b017-745faea39569 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.536880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.537587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.537873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.538120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:38.538235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.538877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.540569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.543674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1092/2187] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:38.554554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1096/2188] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:38.555893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.556163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.558391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.567804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bc5d1-c77c-48f2-820e-2442dd663afb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.572646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.575101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.575512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.575889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] PATH_INFO: `/v3/projects/f72c3f7b90bb4965865d426b5063cbce/users/7ff9b25139e04764a4fd099a6c72627c/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.600177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72c3f7b90bb4965865d426b5063cbce, user_id=7ff9b25139e04764a4fd099a6c72627c, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.603070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ece6d-543e-4eb1-be5f-dab0170f4a89 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.620314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1093/2189] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:38 2022] PUT /identity/v3/projects/f72c3f7b90bb4965865d426b5063cbce/users/7ff9b25139e04764a4fd099a6c72627c/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:38.620676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386dd32-9ea0-4601-933d-7ab81e653304 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.625167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.625454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.625732 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.644240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:38.645643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.651749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:38.681402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.682121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.682288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.682548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.738653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1094/2190] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:38.747087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:38.748791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:38.767173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.769132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.781814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1097/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:38.821870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd4f7-29b5-40e1-ba53-17b6a9e84412 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:38.826544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:38.827881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:38.828469 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:38.828940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:38.840509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:38.842618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7fdf-3fb3-41cd-891d-1332aeccda73 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:38.860553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1095/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:39.570027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:39.584439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d2df8-0841-4b53-bfff-41b2a7fb0e95 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:39.592291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:39.593635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:39.595933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:39.596247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] PATH_INFO: `/v3/users/4037a56111ba4c1b88945b93fe49e9ec` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:39.598889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4037a56111ba4c1b88945b93fe49e9ec)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:39.600893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:39.663745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4037a56111ba4c1b88945b93fe49e9ec'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:39.683353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4037a56111ba4c1b88945b93fe49e9ec'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:39.684226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4037a56111ba4c1b88945b93fe49e9ec'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:39.695670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4037a56111ba4c1b88945b93fe49e9ec'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:39.704882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4037a56111ba4c1b88945b93fe49e9ec'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:39.714693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1098/2193] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:39 2022] DELETE /identity/v3/users/4037a56111ba4c1b88945b93fe49e9ec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:39.719089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:39.719547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:39.719991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:39.741474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:39.742330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:39.817327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1096/2194] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:39.827969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:39.829618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:39.897177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1ae9f-d544-4936-99f9-a3bd2f072f2a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:39.901564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:39.902220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:39.902878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:39.902878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:39.923108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:39.926794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:39.943880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:39.965899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1099/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:40.487283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:40.489565 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:40.515657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f21b-33dd-4c59-b59d-c479080e5df2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:40.529694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:40.530591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:40.530875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:40.531178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] PATH_INFO: `/v3/projects/ddf5a99f5a594f4ab68d16e0851a7a39` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:40.532952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf5a99f5a594f4ab68d16e0851a7a39)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:40.537386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:40.560840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:40.627591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf5a99f5a594f4ab68d16e0851a7a39', 'request_id': 'req-43d9d71e-dddf-4992-bd79-61dc80165183'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.639368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf5a99f5a594f4ab68d16e0851a7a39', 'request_id': 'req-43d9d71e-dddf-4992-bd79-61dc80165183'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.648658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf5a99f5a594f4ab68d16e0851a7a39', 'request_id': 'req-43d9d71e-dddf-4992-bd79-61dc80165183'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.673844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] The token cache is being invalidate because project ddf5a99f5a594f4ab68d16e0851a7a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:40.674140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.674812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.676814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1097/2196] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:40 2022] DELETE /identity/v3/projects/ddf5a99f5a594f4ab68d16e0851a7a39 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:40.681696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:40.692987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a792ae2-88f2-4d03-a4c6-79d210777579 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:40.813420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:40.814026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:40.814632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:40.814632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] PATH_INFO: `/v3/users/894ed5b4f1d4419c8601f01d0a010e29` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:40.816506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894ed5b4f1d4419c8601f01d0a010e29)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:40.818306 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:40.886703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894ed5b4f1d4419c8601f01d0a010e29'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.901225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894ed5b4f1d4419c8601f01d0a010e29'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.901967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894ed5b4f1d4419c8601f01d0a010e29'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.908928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894ed5b4f1d4419c8601f01d0a010e29'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.917588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3f9274a3-32c3-4e75-a80a-b840705d1ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894ed5b4f1d4419c8601f01d0a010e29'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:40.924446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1100/2197] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:40 2022] DELETE /identity/v3/users/894ed5b4f1d4419c8601f01d0a010e29 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:41.240950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:41.243550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:41.267957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d71e-dddf-4992-bd79-61dc80165183 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:41.343467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:41.344613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.345048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.345332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] PATH_INFO: `/v3/projects/dd3ff36383bb400d927c31339a864f5e` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.346741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3ff36383bb400d927c31339a864f5e)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:41.349650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:41.468303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3ff36383bb400d927c31339a864f5e', 'request_id': 'req-bbee3272-7737-46f6-83cd-90a34df038f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:41.478289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3ff36383bb400d927c31339a864f5e', 'request_id': 'req-bbee3272-7737-46f6-83cd-90a34df038f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:41.494079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3ff36383bb400d927c31339a864f5e', 'request_id': 'req-bbee3272-7737-46f6-83cd-90a34df038f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:41.517684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] The token cache is being invalidate because project dd3ff36383bb400d927c31339a864f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:41.517986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:41.523430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-bbee3272-7737-46f6-83cd-90a34df038f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:41.525175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1098/2198] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:41 2022] DELETE /identity/v3/projects/dd3ff36383bb400d927c31339a864f5e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:41.530259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.530673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.531095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.564294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:41.565648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:41.707285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1101/2199] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:41.707806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.707806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.707806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.730908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:41.733146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:41.751105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1099/2200] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:41.753476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:41.766252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789cd91-b01b-4632-b8a9-31c78d63ccbd None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:41.772832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:41.774114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.774114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.774346 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.775247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:41.775614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:41.777324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:41.793715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1102/2201] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:41.798148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:41.808368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82729f9-ab07-4781-9102-5860fb7e777b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:41.814052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:41.814797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.815182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.816044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.816296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:41.818533 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:41.874844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:41.876105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1100/2202] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:41 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:41.876560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:41.877657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:41.884368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:41.887673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:41.895992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fb583-73cf-4676-8fd1-f89d8a8c860a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:41.961995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53138-c5ea-4d0c-a693-2d55c761fac0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:41.968444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:41.969353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.969763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.970186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.971042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:41.974039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:41.976659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:41.978063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:41.978537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:41.979087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] PATH_INFO: `/v3/users/2734e4f375e4447595fad78ba6744bea` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:41.981038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2734e4f375e4447595fad78ba6744bea)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:41.984335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.005718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1101/2203] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:41 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:42.007262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:42.022753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9e5c-ec58-492f-8210-1c6c4defdc0a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:42.032645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:42.033698 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.034034 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.034384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.035754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:42.037987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.055930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1102/2204] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:42.057947 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:42.075561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2734e4f375e4447595fad78ba6744bea'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:42.076379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529c8a-d868-4527-be27-01fe60dc39ce admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:42.086620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:42.088880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.089752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.091948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2734e4f375e4447595fad78ba6744bea'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:42.092728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2734e4f375e4447595fad78ba6744bea'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:42.093286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.094562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:42.098904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.102006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2734e4f375e4447595fad78ba6744bea'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:42.116339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d1fd5a8b-598b-4419-80ac-e5e15db00762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2734e4f375e4447595fad78ba6744bea'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:42.121812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1103/2205] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:42.123197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:42.126815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:42.132560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1103/2206] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:41 2022] DELETE /identity/v3/users/2734e4f375e4447595fad78ba6744bea => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:42.138729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.139070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.139322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.151066 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353261bd-9989-4d24-9f9a-e13b22db03e2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:42.203984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:42.205577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:42.218864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:42.220152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.220647 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.220927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] PATH_INFO: `/v3/projects/603ab0932f4e4472b67aac272f85b533/users/5b4dae84ba6f46ff88c20c225cf8d180/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.252962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603ab0932f4e4472b67aac272f85b533, user_id=5b4dae84ba6f46ff88c20c225cf8d180, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:42.256714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31c17-4a62-4ed4-8407-e2c77843a5a6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.280915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1104/2207] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:42 2022] PUT /identity/v3/projects/603ab0932f4e4472b67aac272f85b533/users/5b4dae84ba6f46ff88c20c225cf8d180/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:42.293173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.293474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.293754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.354749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] MFA Rules not processed for user `5b4dae84ba6f46ff88c20c225cf8d180`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:42.356840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:42.380386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1104/2208] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:42.394263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:42.396643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:42.424770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:42.427262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:42.469016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1105/2209] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:42.482613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:42.484198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173f6a5-f1d0-4ff1-a8f7-504439cdcd1c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:42.484554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:42.551156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:42.551987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.552233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.552562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.598831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031cbc-78ee-4654-9bc8-0b3a6c7dbe9b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:42.602569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:42.603566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:42.603566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:42.603935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:42.614165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:42.615762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.625312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1106/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:42.628363 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:42.629932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90d80-1897-4cbb-83a3-087bca08e1a8 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:42.640399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1105/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:43.360673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:43.367709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:43.420442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e546b-c095-4e82-b2a5-082c81c31536 service glance] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:43.438200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:43.441367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:43.442225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:43.444083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] PATH_INFO: `/v3/projects/a8beda52682742448f90b6777715d0a3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:43.446395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8beda52682742448f90b6777715d0a3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:43.451709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:43.539020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8beda52682742448f90b6777715d0a3', 'request_id': 'req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:43.551962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8beda52682742448f90b6777715d0a3', 'request_id': 'req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:43.560247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8beda52682742448f90b6777715d0a3', 'request_id': 'req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:43.575104 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] The token cache is being invalidate because project a8beda52682742448f90b6777715d0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:43.575408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:43.576144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-30cb3733-84e2-4b4d-a631-1072d0a4c7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:43.577824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1107/2212] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:43 2022] DELETE /identity/v3/projects/a8beda52682742448f90b6777715d0a3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:43.583067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:43.583540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:43.583631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:43.605161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:43.607856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:43.702641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1106/2213] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:43.704884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:43.705403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:43.705774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:43.758614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:43.774798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:43.788159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1108/2214] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:43.792755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:43.820575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4219a-9940-4dcf-86b8-55923294a569 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:43.827482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:43.828332 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:43.828961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:43.829231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:43.829990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:43.830464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:43.834366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:43.866969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1107/2215] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:43.872257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:43.891294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d553-c459-42fd-aecf-bde9285746a7 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:43.897505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:43.898191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:43.898478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:43.898794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:43.901711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:43.901711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:43.937287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1109/2216] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:43 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:43.944489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:43.957571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacbe57-8580-4701-acb9-783043d2c82c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:43.970954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:44.025928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.026707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.027023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.027604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.028422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.030423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.059833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1108/2217] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:43 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:44.065255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.081176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575822-2305-4452-bc6b-944df4e88d8b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.086500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.087264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.087556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.087837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.088976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.090856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.110762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1110/2218] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:44.115113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.132375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24a1e2-610e-4f7f-8471-051a54c6f300 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.139316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.140016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.140305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.140584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.141330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.143343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b513a62-cfb9-409b-8d57-8355a0e519df admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.160164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1109/2219] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:44.164401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.185736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df0bba-9c3a-4f9b-9904-e2bc40386d66 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.202184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.203727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.204089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.204442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] PATH_INFO: `/v3/projects/06af70bcdfc944ff8d0891eeb23e937f/users/63f817885b864333a35a9aa9498f8ee8/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.216984 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:44.230554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06af70bcdfc944ff8d0891eeb23e937f, user_id=63f817885b864333a35a9aa9498f8ee8, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.239247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.261183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1111/2220] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:44 2022] PUT /identity/v3/projects/06af70bcdfc944ff8d0891eeb23e937f/users/63f817885b864333a35a9aa9498f8ee8/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:44.277495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.277790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.278068 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.327840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] MFA Rules not processed for user `63f817885b864333a35a9aa9498f8ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:44.329357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:44.512212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1110/2221] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:44.516305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.603726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547302a2-f1e2-46f2-8c85-e3a346cde691 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.608364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.609031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.609321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.609597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.610288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.612385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.641336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1112/2222] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:44 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:44.645585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.658284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653e92-1481-41dd-80f2-e75d5e5e8153 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.729791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.731364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.731825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.732239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.733521 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.736461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.770620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1111/2223] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:44 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:44.771922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.783868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e9dc7-3dfb-441e-9743-1233869674b7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.796865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.797076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.797490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.797841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.798669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.800679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.813761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1113/2224] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:44.819820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.835445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4183c-227a-4844-be0d-83d7a829cfd9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.849078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.849078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.849078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.849078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.849961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.851726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3c6b4-781b-4530-86c7-32fbf51eadfa admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.867944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1112/2225] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:44.869416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:44.881195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea175-1d34-4205-b2f3-2f4259d0d3e9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:44.889678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:44.890146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.890427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.891163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] PATH_INFO: `/v3/projects/a1d40aa8518b471096a280fd55af2cde/users/58eea9b8deff4505a985d171a469cb36/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.907841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d40aa8518b471096a280fd55af2cde, user_id=58eea9b8deff4505a985d171a469cb36, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:44.910777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:44.942957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1114/2226] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:44 2022] PUT /identity/v3/projects/a1d40aa8518b471096a280fd55af2cde/users/58eea9b8deff4505a985d171a469cb36/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:44.954071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:44.954330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:44.954610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:44.961125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:45.002341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] MFA Rules not processed for user `58eea9b8deff4505a985d171a469cb36`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:45.003856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:45.132797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1113/2227] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:45.137133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.235710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8d432-d952-469b-9f2c-248e69041324 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.243228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.243913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.244195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.244470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.245699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.247111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23584640-9d0e-4702-906e-3e0156860b50 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.287390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1115/2228] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:45.288269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.321697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e515ad-3fea-4c52-a64f-c085fc417ac2 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.415652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.416524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.416808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.481963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] MFA Rules not processed for user `7ff9b25139e04764a4fd099a6c72627c`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:45.483628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:45.512180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.512954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:45.513811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.513948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.514393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.515196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.517687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.552678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1114/2229] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:45.557897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.576893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b1e05-bbea-4f12-8761-30769161440f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.599835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.600712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.601070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.601523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.602396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.604899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.630836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1115/2230] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:45.632783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1116/2231] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:45.634818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.637964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.641216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:45.664543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c201cfc-3f1c-49b8-ae1e-5b68f455473f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.672514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ce17-2e55-4cb7-9aa6-176649ec944b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.678529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.679751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.680500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.681387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] PATH_INFO: `/v3/projects/bb6dd0da0fb04dce970b61671fe0a743/users/028934b80d6b4e9e87081c4f06b69062/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.688628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.691692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.692105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.692478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.696971 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.699672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.727771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6dd0da0fb04dce970b61671fe0a743, user_id=028934b80d6b4e9e87081c4f06b69062, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.731337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.744561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1117/2232] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:43:45.749913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.776072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1116/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:45 2022] PUT /identity/v3/projects/bb6dd0da0fb04dce970b61671fe0a743/users/028934b80d6b4e9e87081c4f06b69062/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:45.784167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.844965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46b78-e6fc-41f9-a077-32593fb2bbdb admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.870538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:45.888740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2417-016b-48b9-aa17-7dfae88de049 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.893664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.894392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.894683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.895011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.895751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.897481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.914699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1117/2234] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:45.915688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.918219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.918903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.919214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.919483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.920214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.922473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.926856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c49b0-cf29-4aea-989c-de3dd469cbe3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.932628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:45.933608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.933865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.934142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] PATH_INFO: `/v3/projects/bb6dd0da0fb04dce970b61671fe0a743/users/028934b80d6b4e9e87081c4f06b69062/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.936337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6dd0da0fb04dce970b61671fe0a743, user_id=028934b80d6b4e9e87081c4f06b69062, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:45.939041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3958516-d2c9-426c-bdc5-84907542655c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:45.944530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1118/2235] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:45.949338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:45.959835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f5d60-1c6a-4e7b-a3f9-5f75ba1f717d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:45.963355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1118/2236] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:45 2022] PUT /identity/v3/projects/bb6dd0da0fb04dce970b61671fe0a743/users/028934b80d6b4e9e87081c4f06b69062/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:45.975964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:45.976387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:45.976652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:45.997328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:46.006333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] MFA Rules not processed for user `028934b80d6b4e9e87081c4f06b69062`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:46.007722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:46.035509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:46.036188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:46.036473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:46.036773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:46.037505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:46.039471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:46.049391 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1119/2237] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:46.053612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:46.064879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5b53-f444-42ed-b306-86568391925f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:46.074772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:46.075728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:46.076012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:46.076287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] PATH_INFO: `/v3/projects/495d399d11a846caaa2c604ec7204f8b/users/f2d0553038d948d4a18766d238644cdd/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:46.086926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1119/2238] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:46.091962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d399d11a846caaa2c604ec7204f8b, user_id=f2d0553038d948d4a18766d238644cdd, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:46.094677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:46.098639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:46.100292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:46.111772 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1120/2239] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:46 2022] PUT /identity/v3/projects/495d399d11a846caaa2c604ec7204f8b/users/f2d0553038d948d4a18766d238644cdd/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:46.116152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:46.186485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c40686-70b5-49d0-b974-ad71c194c665 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:46.194126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4621-295b-431d-9691-725bb56b276c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:46.198893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:46.199696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:46.199981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:46.200257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:46.200981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:46.202593 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:46.214276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1121/2240] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:43:46.218311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:46.228041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30049-fcdf-48b0-b59e-06776ab5ef6c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:46.232967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:46.234058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:46.234343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:46.234620 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] PATH_INFO: `/v3/projects/495d399d11a846caaa2c604ec7204f8b/users/f2d0553038d948d4a18766d238644cdd/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:46.236754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d399d11a846caaa2c604ec7204f8b, user_id=f2d0553038d948d4a18766d238644cdd, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:46.239058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:46.239699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:46.240090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:46.240232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:46.240325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:46.254143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1122/2241] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:46 2022] PUT /identity/v3/projects/495d399d11a846caaa2c604ec7204f8b/users/f2d0553038d948d4a18766d238644cdd/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:43:46.269494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:46.307871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:46.309398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:46.319887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1120/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:43:48.119922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:48.242165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094b9e-800a-4cf5-8e05-b6a293efe33a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:48.246525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:48.247940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:48.257013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:48.258058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:48.332287 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:48.369427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:48.371240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c57d1-35a4-4b78-9861-b9b09a920f82 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:48.384072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1123/2243] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:49.381777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:49.393536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7fbf-f587-4263-af70-e3242bb5fefd service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:49.421201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:49.422438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:49.427524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:49.427936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:49.625677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:49.627371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:49.647451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1121/2244] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:52.578485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add772b-8c86-4f64-8b8e-74518c771ad0 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:52.579417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add772b-8c86-4f64-8b8e-74518c771ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:52.583130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add772b-8c86-4f64-8b8e-74518c771ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:52.650316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5add772b-8c86-4f64-8b8e-74518c771ad0 None None] MFA Rules not processed for user `f2d0553038d948d4a18766d238644cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:52.652319 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5add772b-8c86-4f64-8b8e-74518c771ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:52.864736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1124/2245] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:52.877471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:52.879101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:52.978043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22d7b-fc4d-47ba-9f7f-ff3e54307afb service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:52.985141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:52.986112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:52.986512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:52.986800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:53.095071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:53.096673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:53.115168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1122/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:53.302934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a175-0c39-4226-9248-92756182e222 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:53.303652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a175-0c39-4226-9248-92756182e222 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:53.304083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a175-0c39-4226-9248-92756182e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:53.359152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8032a175-0c39-4226-9248-92756182e222 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:53.372374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8032a175-0c39-4226-9248-92756182e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:53.490239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1125/2247] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:53.549642 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:53.552767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:53.571118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:53.648899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93895e16-d0b2-4d91-94bf-19ab99d58e9b service glance] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:53.655514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:53.656355 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:53.659218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:53.659218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:53.676020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:53.678811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65c688-51e4-4385-ad22-248007e77879 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:53.689352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1123/2248] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:43:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:43:54.186246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a175-0c39-4226-9248-92756182e222 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:54.267924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a175-0c39-4226-9248-92756182e222 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:54.287740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:54.288674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:54.288960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:54.289242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] PATH_INFO: `/v3/users/63f817885b864333a35a9aa9498f8ee8` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:54.295961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f817885b864333a35a9aa9498f8ee8)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:54.303785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:54.312259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:54.401508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f817885b864333a35a9aa9498f8ee8'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:54.402517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f817885b864333a35a9aa9498f8ee8'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:54.413416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f817885b864333a35a9aa9498f8ee8'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:54.413670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f817885b864333a35a9aa9498f8ee8'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:54.430675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f817885b864333a35a9aa9498f8ee8'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:54.475549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1126/2249] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:54 2022] DELETE /identity/v3/users/63f817885b864333a35a9aa9498f8ee8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:54.477756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:54.477756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:54.477756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:54.512507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:54.513734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:54.623406 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1124/2250] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:54.633898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:54.638561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:54.837430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b67ff3-6a05-49d4-b659-494aa47f1d26 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:54.853415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:54.854171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:54.854387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:54.854665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:54.867566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:54.869168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:54.898536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1127/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:55.381118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:55.383314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:55.412688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d391272-3daf-4f3b-9988-638ab6570154 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:55.423823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:55.424722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:55.425002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:55.425305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] PATH_INFO: `/v3/projects/06af70bcdfc944ff8d0891eeb23e937f` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:55.432080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06af70bcdfc944ff8d0891eeb23e937f)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:55.435060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:55.549211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06af70bcdfc944ff8d0891eeb23e937f', 'request_id': 'req-16d2c40c-9288-49c2-9987-ea0315271714'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.557050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06af70bcdfc944ff8d0891eeb23e937f', 'request_id': 'req-16d2c40c-9288-49c2-9987-ea0315271714'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.566413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06af70bcdfc944ff8d0891eeb23e937f', 'request_id': 'req-16d2c40c-9288-49c2-9987-ea0315271714'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.612158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] The token cache is being invalidate because project 06af70bcdfc944ff8d0891eeb23e937f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:55.612622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.613701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.616825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1125/2252] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:55 2022] DELETE /identity/v3/projects/06af70bcdfc944ff8d0891eeb23e937f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:55.621115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:55.635284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c51b-b898-4f76-b504-173c19dd821a service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:55.819293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:55.820339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:55.820904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:55.821151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] PATH_INFO: `/v3/users/58eea9b8deff4505a985d171a469cb36` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:55.822556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58eea9b8deff4505a985d171a469cb36)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:55.824814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:55.888988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:55.909543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58eea9b8deff4505a985d171a469cb36'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.910379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58eea9b8deff4505a985d171a469cb36'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.920189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58eea9b8deff4505a985d171a469cb36'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.921134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58eea9b8deff4505a985d171a469cb36'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.939448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58eea9b8deff4505a985d171a469cb36'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:55.957742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1128/2253] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:55 2022] DELETE /identity/v3/users/58eea9b8deff4505a985d171a469cb36 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:56.446655 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:56.448244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:56.480631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c40c-9288-49c2-9987-ea0315271714 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:56.521905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:56.568846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:56.571284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:56.571857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:56.572506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] PATH_INFO: `/v3/projects/a1d40aa8518b471096a280fd55af2cde` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:56.573948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d40aa8518b471096a280fd55af2cde)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:56.576108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:56.647500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d40aa8518b471096a280fd55af2cde', 'request_id': 'req-8852a42a-3f3d-443e-acac-2bc49c655d9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.689740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d40aa8518b471096a280fd55af2cde', 'request_id': 'req-8852a42a-3f3d-443e-acac-2bc49c655d9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.698423 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d40aa8518b471096a280fd55af2cde', 'request_id': 'req-8852a42a-3f3d-443e-acac-2bc49c655d9d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.744863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] The token cache is being invalidate because project a1d40aa8518b471096a280fd55af2cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:56.745174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.745909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.750353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1126/2254] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:56 2022] DELETE /identity/v3/projects/a1d40aa8518b471096a280fd55af2cde => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:56.751588 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:56.753181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:56.774035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861465d9-a0ac-45c0-9b31-4dcdc6fc4a27 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:56.887848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:56.888962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:56.889353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:56.889731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] PATH_INFO: `/v3/users/028934b80d6b4e9e87081c4f06b69062` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:56.891419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028934b80d6b4e9e87081c4f06b69062)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:56.893545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:56.958408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028934b80d6b4e9e87081c4f06b69062'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.959247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028934b80d6b4e9e87081c4f06b69062'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.971107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028934b80d6b4e9e87081c4f06b69062'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.972170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028934b80d6b4e9e87081c4f06b69062'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:56.989821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028934b80d6b4e9e87081c4f06b69062'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.016868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1129/2255] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:43:56 2022] DELETE /identity/v3/users/028934b80d6b4e9e87081c4f06b69062 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:57.222249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:57.223971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:57.298200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a42a-3f3d-443e-acac-2bc49c655d9d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:57.414832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:57.415532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:57.415837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:57.416128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:57.418198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:57.477866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:57.557137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:57.558758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:57.604965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:57.606495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c331c2-108a-4d8d-96f5-4f39ca84ad54 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:57.635412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1127/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:43:57.654857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:57.721097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d161-a072-4940-b008-58b05f9cf122 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:57.730204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:57.731440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:57.732134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:57.732877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] PATH_INFO: `/v3/projects/bb6dd0da0fb04dce970b61671fe0a743` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:57.734826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6dd0da0fb04dce970b61671fe0a743)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:57.736962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:57.823682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6dd0da0fb04dce970b61671fe0a743', 'request_id': 'req-7e4fee56-d4d6-4259-a620-7fab98b72004'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.837934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6dd0da0fb04dce970b61671fe0a743', 'request_id': 'req-7e4fee56-d4d6-4259-a620-7fab98b72004'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.868132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6dd0da0fb04dce970b61671fe0a743', 'request_id': 'req-7e4fee56-d4d6-4259-a620-7fab98b72004'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.887880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] The token cache is being invalidate because project bb6dd0da0fb04dce970b61671fe0a743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:43:57.888534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.889536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7e4fee56-d4d6-4259-a620-7fab98b72004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:43:57.896736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1130/2257] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:43:57 2022] DELETE /identity/v3/projects/bb6dd0da0fb04dce970b61671fe0a743 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:57.897887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:57.898182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:57.898484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:57.922131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:57.924382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:58.079029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08362a-852c-4951-881e-b781a42747ef None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.079343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08362a-852c-4951-881e-b781a42747ef None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.079853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08362a-852c-4951-881e-b781a42747ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.088931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1128/2258] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:43:58.116785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ff08362a-852c-4951-881e-b781a42747ef None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:58.118218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ff08362a-852c-4951-881e-b781a42747ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:58.132257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1131/2259] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:58.133787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.149228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7911-47f9-4a54-b283-30ef98b3abd0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.158019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.158838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.159217 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.159561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.160972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:43:58.161352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.163127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.187529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1129/2260] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:43:58.188809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08362a-852c-4951-881e-b781a42747ef None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.204654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08362a-852c-4951-881e-b781a42747ef None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.217258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.219793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.220330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.221259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.224087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.227402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.285655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1132/2261] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:43:58 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:58.289687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.308409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdf5b5-c9ac-40f3-84ac-664aaf2ba2c8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.428486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.430769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.431664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.431664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.433872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.441248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.507131 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.521625 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1130/2262] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:43:58 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:43:58.530122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afcd67-4baa-49db-9a34-c38bdf2df75f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.543092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.543783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.544580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.544580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.545132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.546880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.582608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1133/2263] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:58.583958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.596589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c424e3e-2620-499b-aa52-4b16f037b0ae admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.609601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.611239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.612107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.612443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.622717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.624774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5054e-620d-49aa-9cc1-fd66a0dcfce4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.665948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1131/2264] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:43:58.678012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:58.695507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f152b6-8220-4407-b810-115c63b6374a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:58.710334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:58.711566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.711989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.712204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] PATH_INFO: `/v3/projects/ca2b5005ee5d414bb9b2e3f47d4f6e7d/users/f0ce6f327418455f98a560d3244ad28c/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.777465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2b5005ee5d414bb9b2e3f47d4f6e7d, user_id=f0ce6f327418455f98a560d3244ad28c, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:58.782449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:58.810645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1134/2265] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:43:58 2022] PUT /identity/v3/projects/ca2b5005ee5d414bb9b2e3f47d4f6e7d/users/f0ce6f327418455f98a560d3244ad28c/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:43:58.822571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fda-47df-4543-82c2-2e3a5885f9f3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:58.823079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fda-47df-4543-82c2-2e3a5885f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:58.828564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fda-47df-4543-82c2-2e3a5885f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:58.904356 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-e9798fda-47df-4543-82c2-2e3a5885f9f3 None None] MFA Rules not processed for user `f0ce6f327418455f98a560d3244ad28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:43:58.905887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e9798fda-47df-4543-82c2-2e3a5885f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:58.961395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:59.079110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1132/2266] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:43:59.090835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:43:59.092699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:43:59.166621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef4b9-2c9f-41bd-a9a4-ebf871d76088 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:43:59.170602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:43:59.171484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:43:59.171939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:43:59.172213 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:43:59.180761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:43:59.183656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:43:59.185671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325a5d7-0361-4d50-a36f-a5c246fff942 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:43:59.197447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1135/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:43:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:06.208170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4287-2398-4eec-82a6-c0db67d29910 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:06.208797 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4287-2398-4eec-82a6-c0db67d29910 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:06.208882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf4287-2398-4eec-82a6-c0db67d29910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:06.229862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-77bf4287-2398-4eec-82a6-c0db67d29910 None None] MFA Rules not processed for user `7ff9b25139e04764a4fd099a6c72627c`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:06.231860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-77bf4287-2398-4eec-82a6-c0db67d29910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:06.298315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1133/2268] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:06.434760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:06.435403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:06.435403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:06.455650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] MFA Rules not processed for user `be0580895be5441d8503d584b33fa954`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:06.456967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:06.524018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1136/2269] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:08.805289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:08.807089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:08.807589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:08.839285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:08.841186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:08.933654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1134/2270] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:44:08.954482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:08.957153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:09.095178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416f0b-9647-43df-858d-0ea71d3ab3a0 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:09.102965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:09.103667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:09.104038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:09.104404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:09.117367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:09.119293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72063426-116a-4190-b877-40ff6cda6dd8 service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:09.130269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1137/2271] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:10.140036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:10.230551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44692640-7156-43d9-bb18-e58a86ee329a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:10.236747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:10.238037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:10.238507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:10.238991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] PATH_INFO: `/v3/users/f0ce6f327418455f98a560d3244ad28c` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:10.240498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ce6f327418455f98a560d3244ad28c)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:10.242632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:10.255822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:10.312992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ce6f327418455f98a560d3244ad28c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.328151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ce6f327418455f98a560d3244ad28c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.328924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ce6f327418455f98a560d3244ad28c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.339536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ce6f327418455f98a560d3244ad28c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.349565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ce6f327418455f98a560d3244ad28c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.356036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1135/2272] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:10 2022] DELETE /identity/v3/users/f0ce6f327418455f98a560d3244ad28c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:10.360805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:10.361289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:10.361429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:10.379922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:10.381174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:10.456523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1138/2273] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:10.467216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:10.468972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:10.537794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ad6-b228-4831-a3c3-1a5656fd8cce admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:10.541778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:10.542441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:10.542729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:10.543026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:10.553442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:10.554907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8dab8-0bc5-4ce0-8b8b-92839fe62cdc service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:10.565974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1136/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:10.605247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:10.606953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:10.624397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d85a3-86f6-4efa-8eb8-e1225ca89187 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:10.630609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:10.635998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:10.636293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:10.636581 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] PATH_INFO: `/v3/users/5b4dae84ba6f46ff88c20c225cf8d180` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:10.641072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4dae84ba6f46ff88c20c225cf8d180)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:10.647649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:10.741364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:10.769223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4dae84ba6f46ff88c20c225cf8d180'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.769904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4dae84ba6f46ff88c20c225cf8d180'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.779075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4dae84ba6f46ff88c20c225cf8d180'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.780321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4dae84ba6f46ff88c20c225cf8d180'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.823866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4dae84ba6f46ff88c20c225cf8d180'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:10.854052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1139/2275] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:10 2022] DELETE /identity/v3/users/5b4dae84ba6f46ff88c20c225cf8d180 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:10.855570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:10.856008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:10.856125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:10.892349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:10.893622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:10.991286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1137/2276] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:11.006359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:11.008079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:11.032398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:11.033977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:11.048333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247e913-3cce-41cb-a364-49f0c34ebfca None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:11.054298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:11.055520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:11.055965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:11.056414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] PATH_INFO: `/v3/projects/ca2b5005ee5d414bb9b2e3f47d4f6e7d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:11.057808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2b5005ee5d414bb9b2e3f47d4f6e7d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:11.083843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:11.130837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f910d-04c9-4f49-97e0-de5854c6f0ae admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:11.135198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:11.136271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:11.136566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:11.136847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:11.152681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:11.159235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:11.162651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:11.187503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1140/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:11.207254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2b5005ee5d414bb9b2e3f47d4f6e7d', 'request_id': 'req-b9d12362-c690-469e-b5e6-3b47d54cf302'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:11.210065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2b5005ee5d414bb9b2e3f47d4f6e7d', 'request_id': 'req-b9d12362-c690-469e-b5e6-3b47d54cf302'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:11.226631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2b5005ee5d414bb9b2e3f47d4f6e7d', 'request_id': 'req-b9d12362-c690-469e-b5e6-3b47d54cf302'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:11.247716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] The token cache is being invalidate because project ca2b5005ee5d414bb9b2e3f47d4f6e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:11.247948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:11.249649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9d12362-c690-469e-b5e6-3b47d54cf302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:11.280178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1138/2278] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:11 2022] DELETE /identity/v3/projects/ca2b5005ee5d414bb9b2e3f47d4f6e7d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:44:11.999653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.001649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:12.023121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a324c5-1785-4f10-8f53-1b82169e9425 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.139665 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.141028 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.141477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.141983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] PATH_INFO: `/v3/projects/603ab0932f4e4472b67aac272f85b533` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.144235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603ab0932f4e4472b67aac272f85b533)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.146545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.204043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:12.206045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603ab0932f4e4472b67aac272f85b533', 'request_id': 'req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:12.221069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603ab0932f4e4472b67aac272f85b533', 'request_id': 'req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:12.229137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603ab0932f4e4472b67aac272f85b533', 'request_id': 'req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:12.254713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] The token cache is being invalidate because project 603ab0932f4e4472b67aac272f85b533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:12.255271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:12.256116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ffed0c33-67e5-45b6-b1db-1429bb3e4a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:12.258249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1141/2279] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:11 2022] DELETE /identity/v3/projects/603ab0932f4e4472b67aac272f85b533 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:12.263484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.264116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.264952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.288953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:12.290295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:12.372453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1139/2280] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:12.374320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.374567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.374868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.395890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:12.397097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:12.406561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1142/2281] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:12.410783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.422086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083dadc-fd31-4626-840d-791ba24f6cfa None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.427099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.427780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.428113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.428394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.429186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:44:12.429498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.431230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.447438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1140/2282] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:44:12.460430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.467845 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710a185-172e-48fd-9fab-19be4ecd7ca4 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.473867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.474553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.474843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.475149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.475968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.478908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.514953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1143/2283] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:12 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:12.517712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.528133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925af4-9b85-4f3b-ba8c-2ffdf3bcb31e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.589767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.590182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.590472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.590750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.591506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.593466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.620773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1141/2284] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:12 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:12.621956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.632744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6b5b-ec61-4e95-b8ce-6ee78bf868db admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.637284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.637959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.638241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.638512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.639285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.641051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.652413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1144/2285] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:12.656635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.670292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99395e-c200-49bc-a466-4dbb95a90d9a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.678910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.679825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.680172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.680574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.681787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.683912 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c098-dae9-4fe2-a03e-2f95a869eafc admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.697395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1142/2286] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:12.701290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:12.712166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd744f7a-59a0-4585-aa57-52fa2b006de8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:12.717708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:12.718654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.719007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.719292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] PATH_INFO: `/v3/projects/75d346b9114b4b6d9115fce50aca2fd6/users/6dad7e1f78b84d73b2cde1d6a5f87f5f/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.735373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d346b9114b4b6d9115fce50aca2fd6, user_id=6dad7e1f78b84d73b2cde1d6a5f87f5f, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:12.738153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:12.753650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1145/2287] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:12 2022] PUT /identity/v3/projects/75d346b9114b4b6d9115fce50aca2fd6/users/6dad7e1f78b84d73b2cde1d6a5f87f5f/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:12.826505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cbc9-45cd-4b0e-adeb-2ea5b4944ca4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:12.826817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cbc9-45cd-4b0e-adeb-2ea5b4944ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:12.827380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cbc9-45cd-4b0e-adeb-2ea5b4944ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:12.887495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-4450cbc9-45cd-4b0e-adeb-2ea5b4944ca4 None None] MFA Rules not processed for user `6dad7e1f78b84d73b2cde1d6a5f87f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:12.890103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4450cbc9-45cd-4b0e-adeb-2ea5b4944ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:12.929560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:13.119823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1143/2288] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:13.124078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:13.126519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:13.226626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce4e-41ec-492a-a486-c74f8792ddb2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:13.231642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:13.232470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:13.232889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:13.234697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:13.244525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:13.246413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:13.279559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1146/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:44:15.264382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:15.264976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:15.264976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:15.300952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] MFA Rules not processed for user `6dad7e1f78b84d73b2cde1d6a5f87f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:15.302851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:15.341490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1144/2290] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:21.789691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:21.791668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:21.902701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f3b53-3052-4bfd-97c3-df4d92bba6da service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:21.907841 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:21.908736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:21.909080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:21.909780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] PATH_INFO: `/v3/users/8b9e84e764ed48128b6161037e5132c2` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:21.910807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9e84e764ed48128b6161037e5132c2)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:21.913075 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:21.931419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:21.966296 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9e84e764ed48128b6161037e5132c2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:21.966717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9e84e764ed48128b6161037e5132c2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:21.975029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9e84e764ed48128b6161037e5132c2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:21.975689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9e84e764ed48128b6161037e5132c2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:21.989695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9e84e764ed48128b6161037e5132c2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.004968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1147/2291] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:21 2022] DELETE /identity/v3/users/8b9e84e764ed48128b6161037e5132c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:22.187905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:22.200997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0439f-4922-481e-8763-8cbac767a96a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:22.266212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:22.267154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:22.267437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:22.267711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] PATH_INFO: `/v3/projects/d690ba7df3a7400faa02b8da1fe3dee4` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:22.269556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d690ba7df3a7400faa02b8da1fe3dee4)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:22.271513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:22.319837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd690ba7df3a7400faa02b8da1fe3dee4', 'request_id': 'req-d652b7f6-16d9-4838-ba44-d818b1a59151'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.325566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd690ba7df3a7400faa02b8da1fe3dee4', 'request_id': 'req-d652b7f6-16d9-4838-ba44-d818b1a59151'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.331974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd690ba7df3a7400faa02b8da1fe3dee4', 'request_id': 'req-d652b7f6-16d9-4838-ba44-d818b1a59151'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.347064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] The token cache is being invalidate because project d690ba7df3a7400faa02b8da1fe3dee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:22.347362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.348004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.349818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1145/2292] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:22 2022] DELETE /identity/v3/projects/d690ba7df3a7400faa02b8da1fe3dee4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:44:22.353815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:22.355421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:22.369150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0074e6-b8f4-4287-9239-0e8237e21022 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:22.444271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:22.445393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:22.445824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:22.446365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] PATH_INFO: `/v3/users/13c38acf35ce491092fddebf290a8cb9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:22.447756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c38acf35ce491092fddebf290a8cb9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:22.451197 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:22.517652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c38acf35ce491092fddebf290a8cb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.518317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c38acf35ce491092fddebf290a8cb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.527365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c38acf35ce491092fddebf290a8cb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.528087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c38acf35ce491092fddebf290a8cb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.542728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f5c0faac-495d-4642-8f14-9e149585cb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c38acf35ce491092fddebf290a8cb9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:22.562160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1148/2293] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:22 2022] DELETE /identity/v3/users/13c38acf35ce491092fddebf290a8cb9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:23.466430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:23.467872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:23.481326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652b7f6-16d9-4838-ba44-d818b1a59151 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:23.554873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:23.609315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:23.610494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:23.610779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:23.611651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] PATH_INFO: `/v3/projects/86595172e66444599edeea74546752c9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:23.613315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=86595172e66444599edeea74546752c9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:23.620676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:23.692267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86595172e66444599edeea74546752c9', 'request_id': 'req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:23.700419 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86595172e66444599edeea74546752c9', 'request_id': 'req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:23.709289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86595172e66444599edeea74546752c9', 'request_id': 'req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:23.730654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] The token cache is being invalidate because project 86595172e66444599edeea74546752c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:23.731022 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:23.732129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-c31c0cff-4585-4e08-a2d9-2fc2af16d3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:23.737483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1146/2294] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:23 2022] DELETE /identity/v3/projects/86595172e66444599edeea74546752c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:23.742743 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:23.743368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:23.743589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:23.772956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:23.774539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:23.794597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:23.868876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1149/2295] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:23.876656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:23.876943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:23.877218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:23.895924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:23.897121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:23.904847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1147/2296] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:44:23.909309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:23.920428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed57c-347c-4105-a2ba-3b0f85c49c37 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:23.925887 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:23.926500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:23.926793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:23.927149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:23.927838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:44:23.928144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:23.929746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:23.944054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1150/2297] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:44:23.948624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:23.957976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa20d7-24e2-4f78-98e8-1097e30976e9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:23.962683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:23.963687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:23.963964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:23.964233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:23.964925 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:23.966811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:23.994944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1148/2298] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:23 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:23.998835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.009814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bddf8-b979-4b7a-a591-9c44bf11319c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.069395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.070077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.070362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.070663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.071420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.073433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.095087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1151/2299] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:23 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:24.099326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.109851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c27d-0eba-452e-8c03-3aeecbfdcf43 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.115308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.116002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.116288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.116565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.117298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.118929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.130805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1149/2300] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:24.135539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.149765 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168beebd-4fde-40c8-bec0-e59645734afa admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.155412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.156070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.156350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.156624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.157345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.158968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcf43d-367c-412f-ac2e-a40ac6d9ca0d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.169438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1152/2301] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:24.173695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.183873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dbcef-e2f3-46e0-8142-b3552667e683 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.189093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.189972 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.190251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.190715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] PATH_INFO: `/v3/projects/8afa8d2415b94622abb04a4d506b364f/users/d180b224806149148ec7f67274b1dc45/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.206770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afa8d2415b94622abb04a4d506b364f, user_id=d180b224806149148ec7f67274b1dc45, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.209554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.225584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1150/2302] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:24 2022] PUT /identity/v3/projects/8afa8d2415b94622abb04a4d506b364f/users/d180b224806149148ec7f67274b1dc45/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:44:24.236214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.236504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.236814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.265518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] MFA Rules not processed for user `d180b224806149148ec7f67274b1dc45`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:24.266742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:24.335139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1153/2303] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:24.367125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.369074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:24.431007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4350a9d-e13b-452a-a06b-a5eb557ba46a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.435458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.436265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.436549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.436890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.449369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.450812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32f124-a6b4-4c64-b8f1-ce96f749420c service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.461005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1151/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:24.476188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.487324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:24.547722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cf9d-6a84-4f5f-acb8-f601c4487e46 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.554279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.555210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.555488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.555756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] PATH_INFO: `/v3/users/d180b224806149148ec7f67274b1dc45` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.556981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d180b224806149148ec7f67274b1dc45)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.558908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.642942 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd180b224806149148ec7f67274b1dc45'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:24.645029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd180b224806149148ec7f67274b1dc45'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:24.676016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd180b224806149148ec7f67274b1dc45'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:24.677323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd180b224806149148ec7f67274b1dc45'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:24.693522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd180b224806149148ec7f67274b1dc45'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:24.716836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1154/2305] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:24 2022] DELETE /identity/v3/users/d180b224806149148ec7f67274b1dc45 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:24.721316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.722258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.722748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.729656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:24.749361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:24.753978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:24.858382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1152/2306] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:24.871791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:24.873839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:24.941316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f03e-1c25-4242-a387-aee3916780a2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:24.945234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:24.945834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:24.946120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:24.946399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:24.956126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:24.957612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e54db2-06f7-441e-a5a4-0455b5829a2f service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:24.967763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1155/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:25.321784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.323874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:25.337524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c4e5d-80a4-4cb3-9a62-ce12500dab71 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.343529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.344472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.344754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.345029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] PATH_INFO: `/v3/projects/8afa8d2415b94622abb04a4d506b364f` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.346272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8afa8d2415b94622abb04a4d506b364f)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.348523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.400746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afa8d2415b94622abb04a4d506b364f', 'request_id': 'req-8a434b26-d1c1-49ac-a6c1-57e0dd751018'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:25.406082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afa8d2415b94622abb04a4d506b364f', 'request_id': 'req-8a434b26-d1c1-49ac-a6c1-57e0dd751018'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:25.413063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afa8d2415b94622abb04a4d506b364f', 'request_id': 'req-8a434b26-d1c1-49ac-a6c1-57e0dd751018'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:25.431326 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] The token cache is being invalidate because project 8afa8d2415b94622abb04a4d506b364f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:25.431737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:25.432483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8a434b26-d1c1-49ac-a6c1-57e0dd751018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:25.434538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1153/2308] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:25 2022] DELETE /identity/v3/projects/8afa8d2415b94622abb04a4d506b364f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:25.439693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.439991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.440324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.460281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:25.461503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:25.488560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:25.525789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1156/2309] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:25.535105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.535501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.535858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.555147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:25.556371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:25.564850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1154/2310] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:25.568996 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.578525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8a97e-44a5-4420-b3e1-ae0f93c02360 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.583627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.584312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.584574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.584843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.585561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:44:25.585857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.587489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.599752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1157/2311] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:44:25.604135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.614849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677890e2-8cd3-4b61-aefc-e74305341339 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.620840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.621502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.621824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.622064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.622749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.624763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.657199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1155/2312] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:25 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:25.663070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.681478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cba39-9052-4cd1-9920-ef40eddff6aa admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.748426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.749147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.749440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.749720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.750474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.752505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.777021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1158/2313] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:25 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:25.780961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.791303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e569d-03e4-472b-9a61-423ce728d56a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.796112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.796778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.797062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.797333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.798061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.799763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.810399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1156/2314] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:44:25.814527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.825085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc2d5-22c1-4078-afd1-9540116f301f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.829747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.830411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.830699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.831029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.831784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.833407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40912366-4825-4ac3-bcce-83fca4230b8b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.844536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1159/2315] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:44:25.848823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:25.858845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba44e6-c966-4821-8004-ea3bd94e3ab0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:25.863712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:25.864594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.864873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.865173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] PATH_INFO: `/v3/projects/f2efee66dc914ae2a12b7425058e00b9/users/7e995a9e21574eaeb7ea5f18c946f008/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.880180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2efee66dc914ae2a12b7425058e00b9, user_id=7e995a9e21574eaeb7ea5f18c946f008, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:25.882837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:25.897480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1157/2316] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:25 2022] PUT /identity/v3/projects/f2efee66dc914ae2a12b7425058e00b9/users/7e995a9e21574eaeb7ea5f18c946f008/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:25.909080 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:25.909671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:25.909818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:25.946368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] MFA Rules not processed for user `7e995a9e21574eaeb7ea5f18c946f008`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:25.948389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:26.019738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1160/2317] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:26.024183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.048661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:26.087597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f4f-67a5-418c-9068-d6461d21ecc5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.093142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.093837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.094147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.094422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.095173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.097343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.129067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1158/2318] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:26 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:26.130424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.141809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38de9-ca43-452c-8913-39454a12b063 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.168710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:26.204052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.204744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.205023 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.205292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.206064 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.208659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.231667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1161/2319] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:26 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:26.235791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.247266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e216c9-2399-43cd-8ffa-5e39f0b614b3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.252225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.252978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.253263 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.253537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.254471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.256195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.267341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1159/2320] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:26.272107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.282038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998cb10-ee54-4cd2-b128-ce53b418d81d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.288830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.289827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.290255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.290596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.291771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.294323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842f767-e94b-4dea-be8c-ef72b217319f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.306402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1162/2321] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:26.310517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.322265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba99c-9a42-4792-9496-20a745b82ef2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.328353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.329254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.329536 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.329810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] PATH_INFO: `/v3/projects/a6676cbe860f4a5c8b513091d4c3fd28/users/a3c02ea8db584bff902bd3379d1a388a/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.346074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6676cbe860f4a5c8b513091d4c3fd28, user_id=a3c02ea8db584bff902bd3379d1a388a, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.349069 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.365253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1160/2322] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:26 2022] PUT /identity/v3/projects/a6676cbe860f4a5c8b513091d4c3fd28/users/a3c02ea8db584bff902bd3379d1a388a/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:26.374946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.375263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.375545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.403869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] MFA Rules not processed for user `a3c02ea8db584bff902bd3379d1a388a`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:26.405387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:26.478840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1163/2323] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:26.483251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.546107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5984da8-7d12-4a54-919d-831ebb69b7ee admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.552171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.552904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.553168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.553443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.554121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.556064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.583616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1161/2324] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:26 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:26.587785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.603240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f72-a8c8-4fb6-8df2-a36980953a78 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.678192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.679042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.679328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.679602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.680339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.682301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.708343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1164/2325] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:26 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:44:26.712277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.724308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277f5b4-50b4-4b7b-a4de-09e3b2a0885c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.729380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.730052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.730335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.730610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.731384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.733063 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.744674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1162/2326] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:26.748908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.759991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17eee-5c48-4243-84d7-089a3078023e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.765613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.766541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.766825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.767123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] PATH_INFO: `/v3/projects/e457e4a5b285436aaf085453d44bb2a3/users/fa3b0644a00b417fa55bd3bf2b2b3549/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.783380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e457e4a5b285436aaf085453d44bb2a3, user_id=fa3b0644a00b417fa55bd3bf2b2b3549, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.786477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.799185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:26.804994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1165/2327] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:26 2022] PUT /identity/v3/projects/e457e4a5b285436aaf085453d44bb2a3/users/fa3b0644a00b417fa55bd3bf2b2b3549/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:26.808937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.822426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2e42-910a-413a-9be6-560efa1b80b0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.883245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:26.908880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.909298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.909651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.910140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.915411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.917293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8912078-5d6c-48d7-95ec-8e334823a932 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:26.944039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1163/2328] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:26.948116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:26.960813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9253-75cf-4c48-ac86-afc83cd485f7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:26.981977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:26.983010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:26.983302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:26.984221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] PATH_INFO: `/v3/projects/e457e4a5b285436aaf085453d44bb2a3/users/fa3b0644a00b417fa55bd3bf2b2b3549/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:26.993072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e457e4a5b285436aaf085453d44bb2a3, user_id=fa3b0644a00b417fa55bd3bf2b2b3549, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:26.996606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:27.019060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1166/2329] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:26 2022] PUT /identity/v3/projects/e457e4a5b285436aaf085453d44bb2a3/users/fa3b0644a00b417fa55bd3bf2b2b3549/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:27.028435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:27.028726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:27.029004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:27.075301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] MFA Rules not processed for user `fa3b0644a00b417fa55bd3bf2b2b3549`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:27.076598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:27.157963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1164/2330] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:27.169274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:27.171000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:27.231184 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845e789-2a2c-4afb-b0d9-0221f234c9c3 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:27.235763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:27.236416 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:27.236699 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:27.236994 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:27.300883 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:27.302397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:27.317885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1167/2331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:28.989668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:28.991340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:29.004670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f106c-774d-4c44-9a69-838940161efe None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:29.008899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:29.009574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:29.009881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:29.010156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:29.076756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:29.078310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeb304-ead2-4326-8c60-6b10541ed719 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:29.089243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1165/2332] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:29.684453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:29.694021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41026eb9-3092-44d4-a19d-1104af18f226 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:29.698159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:29.698804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:29.699121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:29.699398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:29.709746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:29.711209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:29.721686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1168/2333] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:31.288832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a227-639b-4571-be79-97bc620a0c4a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:31.290300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a227-639b-4571-be79-97bc620a0c4a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:31.290741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a227-639b-4571-be79-97bc620a0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:31.311615 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9e20a227-639b-4571-be79-97bc620a0c4a None None] MFA Rules not processed for user `0e69fea1eeb5453aa4b09799894b1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:31.312954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9e20a227-639b-4571-be79-97bc620a0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:31.434984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1166/2334] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:44:33.829271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:33.905868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633681e5-d3f1-4ff5-97d5-14f3d0122c7c service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:33.912001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:33.913209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:33.913209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:33.913392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] PATH_INFO: `/v3/users/7e995a9e21574eaeb7ea5f18c946f008` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:33.914567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e995a9e21574eaeb7ea5f18c946f008)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:33.916609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:33.955740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:33.973871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e995a9e21574eaeb7ea5f18c946f008'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:33.974649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e995a9e21574eaeb7ea5f18c946f008'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:33.982151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e995a9e21574eaeb7ea5f18c946f008'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:33.982821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e995a9e21574eaeb7ea5f18c946f008'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:33.995708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e995a9e21574eaeb7ea5f18c946f008'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.010877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1169/2335] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:33 2022] DELETE /identity/v3/users/7e995a9e21574eaeb7ea5f18c946f008 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:34.015404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:34.015899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:34.015996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:34.034424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:34.035680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:34.041262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:34.102098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1167/2336] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:34.109124 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:34.110612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:34.170819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ff07-2659-41da-a9be-c0856405def6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:34.175215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:34.175926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:34.176361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:34.176646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:34.187839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:34.189325 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:34.200487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1170/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:34.629035 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:34.631848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:34.651242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8ae35-15fe-4042-bc93-277fcbd32c03 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:34.664970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:34.672942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:34.675066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:34.688084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] PATH_INFO: `/v3/projects/f2efee66dc914ae2a12b7425058e00b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:34.715566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2efee66dc914ae2a12b7425058e00b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:34.718411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:34.780676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2efee66dc914ae2a12b7425058e00b9', 'request_id': 'req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.786589 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2efee66dc914ae2a12b7425058e00b9', 'request_id': 'req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.793471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2efee66dc914ae2a12b7425058e00b9', 'request_id': 'req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.816958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] The token cache is being invalidate because project f2efee66dc914ae2a12b7425058e00b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:34.817551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.818166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.820114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1168/2338] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:34 2022] DELETE /identity/v3/projects/f2efee66dc914ae2a12b7425058e00b9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:34.824575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:34.837531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8dcd-06ce-4cf5-aeb0-e7491fd98964 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:34.919688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:34.921610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:34.921610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:34.921610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] PATH_INFO: `/v3/users/a3c02ea8db584bff902bd3379d1a388a` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:34.922785 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c02ea8db584bff902bd3379d1a388a)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:34.925303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:34.995111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c02ea8db584bff902bd3379d1a388a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:34.995907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c02ea8db584bff902bd3379d1a388a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.003152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:35.006250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c02ea8db584bff902bd3379d1a388a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.007264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c02ea8db584bff902bd3379d1a388a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.022737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c02ea8db584bff902bd3379d1a388a'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.055412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1171/2339] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:34 2022] DELETE /identity/v3/users/a3c02ea8db584bff902bd3379d1a388a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:35.423366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:35.425578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:35.439095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca6f9-6e17-4d01-9eee-7d5e7f90f99d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:35.506178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:35.507508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:35.507800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:35.508077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] PATH_INFO: `/v3/projects/a6676cbe860f4a5c8b513091d4c3fd28` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:35.509314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6676cbe860f4a5c8b513091d4c3fd28)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:35.511604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:35.551181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:35.560988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6676cbe860f4a5c8b513091d4c3fd28', 'request_id': 'req-79683463-5017-47f6-aa49-93c6e0145680'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.569100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6676cbe860f4a5c8b513091d4c3fd28', 'request_id': 'req-79683463-5017-47f6-aa49-93c6e0145680'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.576003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6676cbe860f4a5c8b513091d4c3fd28', 'request_id': 'req-79683463-5017-47f6-aa49-93c6e0145680'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.590622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] The token cache is being invalidate because project a6676cbe860f4a5c8b513091d4c3fd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:35.590910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.591557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.593357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1169/2340] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:35 2022] DELETE /identity/v3/projects/a6676cbe860f4a5c8b513091d4c3fd28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:35.597633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:35.599111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:35.612303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca84af-01b4-4e98-b21f-7002f19a9dbd admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:35.695780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:35.696838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:35.697127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:35.697455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] PATH_INFO: `/v3/users/fa3b0644a00b417fa55bd3bf2b2b3549` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:35.699009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3b0644a00b417fa55bd3bf2b2b3549)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:35.701339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:35.776659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3b0644a00b417fa55bd3bf2b2b3549'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.777330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3b0644a00b417fa55bd3bf2b2b3549'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.789283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3b0644a00b417fa55bd3bf2b2b3549'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.789283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3b0644a00b417fa55bd3bf2b2b3549'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.799487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-442d0a3d-cacd-477b-ab58-0aec2f003d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3b0644a00b417fa55bd3bf2b2b3549'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:35.816351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1172/2341] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:35 2022] DELETE /identity/v3/users/fa3b0644a00b417fa55bd3bf2b2b3549 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:36.107940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.109489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:36.122766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683463-5017-47f6-aa49-93c6e0145680 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.183802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.184684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.184968 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.185380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] PATH_INFO: `/v3/projects/e457e4a5b285436aaf085453d44bb2a3` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.186689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e457e4a5b285436aaf085453d44bb2a3)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.188724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.239859 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e457e4a5b285436aaf085453d44bb2a3', 'request_id': 'req-611ad430-5438-45e6-bdd3-349b7ab620c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:36.245760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e457e4a5b285436aaf085453d44bb2a3', 'request_id': 'req-611ad430-5438-45e6-bdd3-349b7ab620c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:36.253171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e457e4a5b285436aaf085453d44bb2a3', 'request_id': 'req-611ad430-5438-45e6-bdd3-349b7ab620c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:36.267706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] The token cache is being invalidate because project e457e4a5b285436aaf085453d44bb2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:36.268003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:36.268712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-611ad430-5438-45e6-bdd3-349b7ab620c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:36.270384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1170/2342] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:36 2022] DELETE /identity/v3/projects/e457e4a5b285436aaf085453d44bb2a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:36.275342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.275798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.275945 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.294500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:36.295769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:36.341199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:36.358033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1173/2343] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:36.366747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.367072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.367354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.387368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:36.388745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:36.400773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1171/2344] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:36.405043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.414894 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5f284-6c11-4240-a673-a7326c151953 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.419463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.420133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.420526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.420858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.421636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:44:36.421908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.423634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.436201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1174/2345] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:44:36.441673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.451706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb3976-ba20-4c49-b320-9fb1f83dcfdc None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.457122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.457791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.458075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.458352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.459104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.461045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.489381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1172/2346] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:44:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:36.493137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.503948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fea8c-c9b5-4a97-969b-35cf09a651f3 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.562046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.562725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.563048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.563355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.564048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.566630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.587465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1175/2347] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:44:36 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:44:36.591947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.602282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbe2a-0281-473d-9c15-53c2585e093b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.607293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.607953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.608301 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.608516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.609231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.610826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.625508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1173/2348] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:36.629400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.640008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c8f53-bbc9-4621-bddc-b15160daf265 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.645552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.646212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.646615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.646904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.647662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.649281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc841a6f-4575-49cf-9cb2-acb0ce6173a5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.660483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1176/2349] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:44:36.663857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.675108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7689-4ae3-4875-b2cd-0cc033abdf59 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.680402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.681304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.681586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.681865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] PATH_INFO: `/v3/projects/0c94993bbca348328fd46740d46f2df9/users/fe89a7214dd64ef786cf373f0891b7b5/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.694282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:36.697544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c94993bbca348328fd46740d46f2df9, user_id=fe89a7214dd64ef786cf373f0891b7b5, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.700715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.717731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1174/2350] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:44:36 2022] PUT /identity/v3/projects/0c94993bbca348328fd46740d46f2df9/users/fe89a7214dd64ef786cf373f0891b7b5/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:36.723136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e579c6-d755-4d43-8eaa-6784bda34b72 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.723433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e579c6-d755-4d43-8eaa-6784bda34b72 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.723716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e579c6-d755-4d43-8eaa-6784bda34b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.743363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c3e579c6-d755-4d43-8eaa-6784bda34b72 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:36.744571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c3e579c6-d755-4d43-8eaa-6784bda34b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:36.809918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1177/2351] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:36.820170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:36.822107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:36.893402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c1310-55d5-4fe8-9a08-ba5996a10380 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:36.898528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:36.899375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:36.899692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:36.900200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:36.911467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:36.913910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:36.928004 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1175/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:37.783438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:37.784295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:37.784744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:37.813453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] MFA Rules not processed for user `fe89a7214dd64ef786cf373f0891b7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:37.814858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:37.868471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:37.903684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1178/2353] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:37.914352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:37.920211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:38.073078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03f3f-4f9d-47aa-8263-ce679cc70f0e service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:38.080723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:38.082559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:38.083290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:38.083800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:38.104533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:38.106342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cdfe9-1f9a-413b-a9bb-7b65ee75c12d service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:38.123271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1176/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:38.745497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:38.756337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b695-e998-42c2-af9d-91be2eed0f39 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:38.761166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:38.761828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:38.762111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:38.762386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:38.765006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:38.868953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:38.870535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890f7f-9c0e-47a0-9a56-c276054015a7 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:38.883860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1179/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:39.543488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:39.544029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:39.544029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:39.561984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] MFA Rules not processed for user `fe89a7214dd64ef786cf373f0891b7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:39.563184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:39.570950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1177/2356] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:41.624696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c681aa-fe70-47a2-aa5e-79926aba4986 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:41.625243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c681aa-fe70-47a2-aa5e-79926aba4986 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:41.625465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c681aa-fe70-47a2-aa5e-79926aba4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:41.649759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-01c681aa-fe70-47a2-aa5e-79926aba4986 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:41.651670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-01c681aa-fe70-47a2-aa5e-79926aba4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:41.734906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1180/2357] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:41.751530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:41.753881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:41.878638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d014d4-d5dc-4cc1-92ef-4e1851619e91 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:41.885785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:41.887872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:41.888314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:41.888717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:41.903152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:41.905670 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:41.924887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1178/2358] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:42.764963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8ab5-0344-4226-ae4b-44ebfd0d1d30 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:42.765500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8ab5-0344-4226-ae4b-44ebfd0d1d30 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:42.765500 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8ab5-0344-4226-ae4b-44ebfd0d1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:42.837799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-693c8ab5-0344-4226-ae4b-44ebfd0d1d30 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:42.842787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-693c8ab5-0344-4226-ae4b-44ebfd0d1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:42.869576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1181/2359] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:42.890535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:42.905925 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf429cfe-0bdb-4c8e-ba6d-c363af6a4741 service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:42.911765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:42.912834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:42.913265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:42.913726 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:42.957214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:42.962418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:42.978696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1179/2360] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:43.379524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efe19c-ea3a-4a6c-a5d5-3ee7c34b470d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:43.380449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efe19c-ea3a-4a6c-a5d5-3ee7c34b470d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:43.380802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efe19c-ea3a-4a6c-a5d5-3ee7c34b470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:43.412190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-45efe19c-ea3a-4a6c-a5d5-3ee7c34b470d None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:43.413667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-45efe19c-ea3a-4a6c-a5d5-3ee7c34b470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:43.423648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1182/2361] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:43.437053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:43.454686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dcf9-4913-4280-beb0-ad4e68a73c3a service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:43.464130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:43.464799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:43.465210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:43.465598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:43.472627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:43.478903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:43.481776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:43.499515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1180/2362] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:43.690869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c769-8f5d-442a-afe7-562df8fe9f0b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:43.691399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c769-8f5d-442a-afe7-562df8fe9f0b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:43.691936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c769-8f5d-442a-afe7-562df8fe9f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:43.729130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-be07c769-8f5d-442a-afe7-562df8fe9f0b None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:43.730505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-be07c769-8f5d-442a-afe7-562df8fe9f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:43.749326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1183/2363] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:43.765268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:43.800534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cb11-2d9c-4498-8b1d-b5d27caeb094 service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:43.822574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:43.823458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:43.823750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:43.824029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:43.841396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:43.843048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:43.867923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1181/2364] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:44.135467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12072-d94a-4580-856b-5d5194683289 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:44.136129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12072-d94a-4580-856b-5d5194683289 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:44.136129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12072-d94a-4580-856b-5d5194683289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:44.192286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-46a12072-d94a-4580-856b-5d5194683289 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:44.199975 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-46a12072-d94a-4580-856b-5d5194683289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:44.219456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1184/2365] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:44.249298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:44.272685 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9c683-ce8a-4e2d-90ee-6434569bf9c0 service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:44.279659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:44.280905 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:44.281252 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:44.281601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:44.298359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:44.302565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f647d1-b8d7-4c4e-9fa6-645b588f8781 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:44.324710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1182/2366] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:44:47.258217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a12072-d94a-4580-856b-5d5194683289 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:47.260808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-46a12072-d94a-4580-856b-5d5194683289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:47.282256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a12072-d94a-4580-856b-5d5194683289 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:47.288810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:47.290067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:47.290618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:47.291151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] PATH_INFO: `/v3/users/6dad7e1f78b84d73b2cde1d6a5f87f5f` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:47.292668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dad7e1f78b84d73b2cde1d6a5f87f5f)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:47.295793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:47.403311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dad7e1f78b84d73b2cde1d6a5f87f5f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:47.404383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dad7e1f78b84d73b2cde1d6a5f87f5f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:47.412110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:47.423863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dad7e1f78b84d73b2cde1d6a5f87f5f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:47.434135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dad7e1f78b84d73b2cde1d6a5f87f5f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:47.499171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dad7e1f78b84d73b2cde1d6a5f87f5f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:47.521471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1185/2367] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:44:47 2022] DELETE /identity/v3/users/6dad7e1f78b84d73b2cde1d6a5f87f5f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:47.525882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:47.526474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:47.526474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:47.558697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:47.562714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:47.695698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1183/2368] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:47.710187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:47.711949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:47.855805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8d01-8cf0-4a60-a43d-c389e9ce0c0f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:47.872468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:47.873356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:47.873639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:47.873917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:47.884531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:47.886045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8f96-ee5b-44e8-bc28-5172cd8e5cb9 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:47.898718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1186/2369] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:48.176150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:48.177926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:48.198017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01404af-7fc9-4201-bb20-42d1357e95c4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:48.204851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:48.205824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:48.206170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:48.206514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] PATH_INFO: `/v3/projects/75d346b9114b4b6d9115fce50aca2fd6` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:48.208429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d346b9114b4b6d9115fce50aca2fd6)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:48.210769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:48.278607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d346b9114b4b6d9115fce50aca2fd6', 'request_id': 'req-8c7e600b-1004-4c21-99d7-143b64ef79de'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:48.286970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d346b9114b4b6d9115fce50aca2fd6', 'request_id': 'req-8c7e600b-1004-4c21-99d7-143b64ef79de'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:48.295245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d346b9114b4b6d9115fce50aca2fd6', 'request_id': 'req-8c7e600b-1004-4c21-99d7-143b64ef79de'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:48.315338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] The token cache is being invalidate because project 75d346b9114b4b6d9115fce50aca2fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:44:48.315706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:48.316418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8c7e600b-1004-4c21-99d7-143b64ef79de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:44:48.319261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1184/2370] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:44:48 2022] DELETE /identity/v3/projects/75d346b9114b4b6d9115fce50aca2fd6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:44:57.893343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=36,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:58.311443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:44:59.259209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d21d-4d3b-4037-b25d-9117cca37d7d None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.259933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d21d-4d3b-4037-b25d-9117cca37d7d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.260742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d21d-4d3b-4037-b25d-9117cca37d7d None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.262778 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1187/2371] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:44:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:44:59.274545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46c00-abea-4491-ab2b-8a1d6f9296c4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.275323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46c00-abea-4491-ab2b-8a1d6f9296c4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.275574 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b46c00-abea-4491-ab2b-8a1d6f9296c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.281703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.282010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.282437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.295201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-81b46c00-abea-4491-ab2b-8a1d6f9296c4 None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:59.296578 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-81b46c00-abea-4491-ab2b-8a1d6f9296c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.300756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] MFA Rules not processed for user `fe89a7214dd64ef786cf373f0891b7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:59.301992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.366136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1188/2372] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:44:59.378604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1185/2373] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:59.392879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:59.394461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.457599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02eee5-b437-46db-90f1-c6a77e69968c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:59.461374 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:59.462025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.462312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.462644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.474333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:59.475854 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264c3e8-0e9f-4582-9893-006783924bbf service glance] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:59.487012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1189/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:59.557279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.557573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.557863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.559477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1186/2375] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:44:59.564188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eca0-5ad6-4419-9cbe-c43b293af3bb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.564485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eca0-5ad6-4419-9cbe-c43b293af3bb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.564782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eca0-5ad6-4419-9cbe-c43b293af3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.584225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0960eca0-5ad6-4419-9cbe-c43b293af3bb None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:59.585451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0960eca0-5ad6-4419-9cbe-c43b293af3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.638368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1190/2376] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:59.650208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:59.651988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.671658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa516e7-6168-48d0-a927-4283ce69f176 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:59.675418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:59.676065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.676342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.676613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.684814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:59.686282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1de1-4b30-4500-8595-1531b2940dd8 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:59.695380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1187/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:44:59.779729 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601971-9502-4fd9-944d-fefe54e78757 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.780046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601971-9502-4fd9-944d-fefe54e78757 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.780359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f601971-9502-4fd9-944d-fefe54e78757 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.781820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1191/2378] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:44:59.787631 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1166-32f0-44f6-a5e7-c1aa03ebdd8a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.787999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1166-32f0-44f6-a5e7-c1aa03ebdd8a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.788279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1166-32f0-44f6-a5e7-c1aa03ebdd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.807559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5eee1166-32f0-44f6-a5e7-c1aa03ebdd8a None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:44:59.808799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5eee1166-32f0-44f6-a5e7-c1aa03ebdd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:44:59.818476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1188/2379] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:44:59.829543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f601971-9502-4fd9-944d-fefe54e78757 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:44:59.841286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f601971-9502-4fd9-944d-fefe54e78757 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:44:59.844898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:44:59.845527 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:44:59.845932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:44:59.846212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:44:59.856578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:44:59.858016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:44:59.870154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1192/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:45:04.340621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:04.341134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:04.341134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:04.360629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:04.361826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:04.427928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1189/2381] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:04.442404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:04.443969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:04.494806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:04.517828 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56641a1-ff7f-479b-bbde-75153c1ec671 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:04.522961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:04.523619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:04.523903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:04.524179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:04.533920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:04.535680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dd0d-e39e-435a-9334-b464beb398bf service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:04.544175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1193/2382] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 20:45:14.415721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=65 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:14.541207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=12 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:25.114664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:25.116450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:25.190316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cd7d-cb98-4413-8eb5-542e2e3ddd45 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:25.195858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:25.196727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:25.197007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:25.197276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:25.199158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:25.212240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:25.214280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:25.225680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1190/2383] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:45:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:45:25.966239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dabb5-b213-4d2c-9e73-a0f8154486a3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:25.967172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dabb5-b213-4d2c-9e73-a0f8154486a3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:25.967602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dabb5-b213-4d2c-9e73-a0f8154486a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:25.990380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8f0dabb5-b213-4d2c-9e73-a0f8154486a3 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:26.003650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8f0dabb5-b213-4d2c-9e73-a0f8154486a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:26.021995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1194/2384] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:45:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:45:26.035796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:26.051233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359b4a5-7926-408f-9d29-2fd6b8c04a86 service placement] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:26.059214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:26.061183 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:26.061633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:26.062215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:26.072329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:26.073964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:26.083225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1191/2385] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:45:28.513513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e3778-f01a-46c4-982c-13f14a62ada5 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:28.514004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e3778-f01a-46c4-982c-13f14a62ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:28.514268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e3778-f01a-46c4-982c-13f14a62ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:28.536830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9f3e3778-f01a-46c4-982c-13f14a62ada5 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:28.538249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9f3e3778-f01a-46c4-982c-13f14a62ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:28.546847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1195/2386] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:45:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:28.561016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:28.571843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38357840-88a0-4855-ba5b-0f63ea1d3e60 service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:28.577014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:28.577651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:28.577931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:28.578315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:28.586923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:28.588878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ef2e8-7252-4657-b2c2-b7ba03625ad4 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:28.598074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1192/2387] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 20:45:36.390433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:36.391727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:36.392182 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:36.413702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] MFA Rules not processed for user `be0580895be5441d8503d584b33fa954`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:36.414979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:36.488855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1196/2388] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:38.595179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=44 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:45.307364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f14e3-5838-49e3-a5cd-0b4355776a0b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:45.308026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f14e3-5838-49e3-a5cd-0b4355776a0b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:45.308026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f14e3-5838-49e3-a5cd-0b4355776a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:45.326742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-132f14e3-5838-49e3-a5cd-0b4355776a0b None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:45.327983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-132f14e3-5838-49e3-a5cd-0b4355776a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:45.335206 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1193/2389] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:45:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:45.348938 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:45.361799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf828-d331-4400-af8e-6a5afd36dda1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:45.368837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:45.369575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:45.369920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:45.370258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:45.381489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:45.383204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce698269-edb0-44ef-a436-faa33d230b53 service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:45.394703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1197/2390] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:45:47.536182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:47.537064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:47.537395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:47.539242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1194/2391] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:45:47.553488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:47.554564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:47.554855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:47.590364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] MFA Rules not processed for user `85fda246a5de4acca67f975bd17f8139`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:47.590364 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:47.610566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1198/2392] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:47.625676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:47.628736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:47.636027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:47.637737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:47.654116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2ec1d-fb16-478e-af67-6757d73ed687 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:47.662211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:47.662938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:47.663282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:47.664533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:47.704737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:47.706741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:47.720394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1195/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:45:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:45:47.734330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965270ae-77ff-4f26-a0b8-c9d41008c782 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:47.745065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:47.746143 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:47.746483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:47.746851 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] PATH_INFO: `/v3/users/fe89a7214dd64ef786cf373f0891b7b5` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:47.749873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe89a7214dd64ef786cf373f0891b7b5)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:47.752251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:47.809825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe89a7214dd64ef786cf373f0891b7b5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:47.810498 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe89a7214dd64ef786cf373f0891b7b5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:47.822564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe89a7214dd64ef786cf373f0891b7b5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:47.823572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe89a7214dd64ef786cf373f0891b7b5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:47.837974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-362d338e-17bc-4fd5-944c-2f09e91bb94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe89a7214dd64ef786cf373f0891b7b5'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:47.840484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:47.861174 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1199/2394] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:45:47 2022] DELETE /identity/v3/users/fe89a7214dd64ef786cf373f0891b7b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:45:48.114455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.130435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605529-f79f-4ecb-8e4f-ac21587c390f service placement] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.205271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.206053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.206327 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.206594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] PATH_INFO: `/v3/projects/0c94993bbca348328fd46740d46f2df9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.207986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c94993bbca348328fd46740d46f2df9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.209932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.263759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c94993bbca348328fd46740d46f2df9', 'request_id': 'req-3a39c74a-c809-47e8-9dc1-1487f96dd14c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:48.269832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c94993bbca348328fd46740d46f2df9', 'request_id': 'req-3a39c74a-c809-47e8-9dc1-1487f96dd14c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:48.276156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c94993bbca348328fd46740d46f2df9', 'request_id': 'req-3a39c74a-c809-47e8-9dc1-1487f96dd14c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:48.292271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] The token cache is being invalidate because project 0c94993bbca348328fd46740d46f2df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:45:48.292539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:48.293340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3a39c74a-c809-47e8-9dc1-1487f96dd14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:48.295236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1196/2395] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:45:48 2022] DELETE /identity/v3/projects/0c94993bbca348328fd46740d46f2df9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:45:48.301035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.301327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.301635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.325689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:48.327305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:48.398751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1200/2396] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:48.406550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.406835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.407270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.425973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:48.427215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:48.440767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1197/2397] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:48.445866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.457737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d4d0-cdcd-441b-a97f-30be5930763b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.462880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.463902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.464188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.464451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.465187 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:45:48.465493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.467290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.479112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1201/2398] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:45:48.483846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.493138 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbb413-0d64-4aad-b79f-24eef53f6978 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.498231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.498871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.499182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.499462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.500151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.502053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.530838 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1198/2399] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:45:48 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:45:48.535133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.545293 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba1d9-2982-4304-aeec-9f9b948555db admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.606578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.607285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.607600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.607885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.608583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.610567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.633683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1202/2400] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:45:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:45:48.635026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.645560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3c7f-9dd0-4761-91bf-c49971b5d66f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.650208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.650876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.651197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.651471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.652197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.654687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.670007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1199/2401] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:45:48.674058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.684880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad51b07-5542-4125-b7b3-1373152df819 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.689687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.690420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.690767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.691142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.691957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.693641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022c873-8e0b-4b7b-9c40-60427c0b13a4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.706902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1203/2402] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:45:48.708243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.718637 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b77339-6437-46b4-85b0-a41ee31fd964 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:48.724242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:48.725146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.725422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.725694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] PATH_INFO: `/v3/projects/8b9fe971725641c28c086e2df5aabf28/users/8ae74e3d84664293a563d82818789a07/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.741853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9fe971725641c28c086e2df5aabf28, user_id=8ae74e3d84664293a563d82818789a07, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:48.744572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:48.759218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1200/2403] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:45:48 2022] PUT /identity/v3/projects/8b9fe971725641c28c086e2df5aabf28/users/8ae74e3d84664293a563d82818789a07/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:45:48.824078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:48.824328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:48.824684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:48.853702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] MFA Rules not processed for user `8ae74e3d84664293a563d82818789a07`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:48.854933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:48.909395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:48.932627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1204/2404] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:48.944268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:48.946392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:48.957848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:49.010450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc6f-ab77-44a4-918e-72a545346a7f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:49.017935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:49.018818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:49.019288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:49.019813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:49.029848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:49.031354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20ae2a-71ce-4d3d-b146-04ba9a125aeb service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:49.040841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1201/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:45:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:45:51.594553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:51.671404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833b89b-1b3c-4ec4-a931-c77a5200e326 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:51.677130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:51.678708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:51.678708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:51.678708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] PATH_INFO: `/v3/users/8ae74e3d84664293a563d82818789a07` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:51.680111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae74e3d84664293a563d82818789a07)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:51.682407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:51.733862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae74e3d84664293a563d82818789a07'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:51.734529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae74e3d84664293a563d82818789a07'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:51.741899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae74e3d84664293a563d82818789a07'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:51.742606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae74e3d84664293a563d82818789a07'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:51.758825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae74e3d84664293a563d82818789a07'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:51.773342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1205/2406] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:45:51 2022] DELETE /identity/v3/users/8ae74e3d84664293a563d82818789a07 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:45:51.777990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:51.779049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:51.779049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:51.797058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:51.798190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:51.858863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1202/2407] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:51.868802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:51.870292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:51.935457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c18f4-4c6a-4bf2-8ec6-33572e12d951 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:51.939216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:51.939901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:51.940188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:51.940474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:51.950695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:51.952376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5844f2-0d15-4597-b6a2-fe85b082667e service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:51.963138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1206/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:45:52.242741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.244520 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:52.261291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbceacf-e275-4d80-8c91-2fe333dc60db None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.267945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.268836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.269121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.269400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] PATH_INFO: `/v3/projects/8b9fe971725641c28c086e2df5aabf28` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.270724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9fe971725641c28c086e2df5aabf28)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.272787 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.323431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9fe971725641c28c086e2df5aabf28', 'request_id': 'req-d9473fac-63f5-42d9-831c-ee84af616fa6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:52.328975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9fe971725641c28c086e2df5aabf28', 'request_id': 'req-d9473fac-63f5-42d9-831c-ee84af616fa6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:52.335109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9fe971725641c28c086e2df5aabf28', 'request_id': 'req-d9473fac-63f5-42d9-831c-ee84af616fa6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:52.348913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] The token cache is being invalidate because project 8b9fe971725641c28c086e2df5aabf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:45:52.349191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:52.349796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d9473fac-63f5-42d9-831c-ee84af616fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:45:52.351364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1203/2409] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:45:52 2022] DELETE /identity/v3/projects/8b9fe971725641c28c086e2df5aabf28 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:45:52.356473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.356769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.357053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.375471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:52.376689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:52.381431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:52.446727 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1207/2410] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:45:52.455268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.455586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.455868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.475626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:52.476835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:52.485375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1204/2411] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:52.489634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.500225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b51f2-366e-48aa-8852-4d8d8a219334 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.506294 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.507007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.507332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.507537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.508271 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:45:52.508577 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.510202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.522980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1208/2412] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:45:52.528132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.537591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4feabd-941f-40d0-ba3d-0cadf49fbdee None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.542935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.543652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.543956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.544225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.544938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.546897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.574319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1205/2413] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:45:52 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:45:52.578637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.589515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4697b8-6301-4417-b6f0-49fe3dd09a11 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.656667 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.657471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.657788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.658061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.658895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.661001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.691088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1209/2414] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:45:52 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:45:52.692316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.698941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:45:52.703438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b8f6d-cc29-45be-b462-d122f3ade417 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.711098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.711952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.712310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.712769 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.713826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.715590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.726870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1206/2415] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:45:52.732337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.742902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85194f-fc14-44ce-a984-671c266729de admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.748336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.749020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.749301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.749571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.750291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.751943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3c2a-6d35-4fbe-87f5-d76adce9f1f7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.762827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1210/2416] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:45:52.767919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.785016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8c509-1f36-461d-bebd-b380d6d83b27 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:52.794185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:52.795152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.795413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.795689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] PATH_INFO: `/v3/projects/968722ed834a48788b5e6f9bc24b89ec/users/3c6cc5340ea54e46b20540e802cfc111/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.812289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968722ed834a48788b5e6f9bc24b89ec, user_id=3c6cc5340ea54e46b20540e802cfc111, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:52.814946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:52.830937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1207/2417] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:45:52 2022] PUT /identity/v3/projects/968722ed834a48788b5e6f9bc24b89ec/users/3c6cc5340ea54e46b20540e802cfc111/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:45:52.841428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706595f3-f7d8-42b4-9546-6da6b57dea6d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:52.841720 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706595f3-f7d8-42b4-9546-6da6b57dea6d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:52.841997 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706595f3-f7d8-42b4-9546-6da6b57dea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:52.870970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-706595f3-f7d8-42b4-9546-6da6b57dea6d None None] MFA Rules not processed for user `3c6cc5340ea54e46b20540e802cfc111`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:45:52.872299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-706595f3-f7d8-42b4-9546-6da6b57dea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:52.943060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1211/2418] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:45:52.956748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:45:52.958959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:45:53.022607 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546b1be-6837-4118-8a92-18a782408c45 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:45:53.026198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:45:53.026861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:45:53.027171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:45:53.027445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:45:53.036128 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:45:53.037563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:45:53.046880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1208/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:45:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:46:02.939460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:46:03.042590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:46:08.057126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58335a-c163-47c3-9d01-343935d618c8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:08.057737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58335a-c163-47c3-9d01-343935d618c8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:08.057737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58335a-c163-47c3-9d01-343935d618c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:08.080740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3f58335a-c163-47c3-9d01-343935d618c8 None None] MFA Rules not processed for user `0e69fea1eeb5453aa4b09799894b1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:46:08.081979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3f58335a-c163-47c3-9d01-343935d618c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:08.143322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1212/2420] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:46:16.831430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:46:16.881331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb8c2-7fb1-447b-9ec4-1b4d8cadab07 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:16.881902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb8c2-7fb1-447b-9ec4-1b4d8cadab07 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:16.881902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb8c2-7fb1-447b-9ec4-1b4d8cadab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:16.899733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-dd7bb8c2-7fb1-447b-9ec4-1b4d8cadab07 None None] MFA Rules not processed for user `c26c047c73a748cda14345a2ca3aa319`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:46:16.900931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-dd7bb8c2-7fb1-447b-9ec4-1b4d8cadab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:16.904429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc55f-6ad6-439b-b730-ba1ef0c4d5e0 service glance] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:46:16.909133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:46:16.910023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:16.910365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:16.910646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] PATH_INFO: `/v3/users/3c6cc5340ea54e46b20540e802cfc111` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:16.911939 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6cc5340ea54e46b20540e802cfc111)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:46:16.913951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:46:16.963650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1213/2421] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:46:16.970887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6cc5340ea54e46b20540e802cfc111'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:16.984835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6cc5340ea54e46b20540e802cfc111'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:16.985595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6cc5340ea54e46b20540e802cfc111'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:16.993575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6cc5340ea54e46b20540e802cfc111'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.004696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6cc5340ea54e46b20540e802cfc111'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.011364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1209/2422] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:46:16 2022] DELETE /identity/v3/users/3c6cc5340ea54e46b20540e802cfc111 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:46:17.016097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:17.016383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:17.016661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:17.037381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:46:17.038586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:17.107087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1214/2423] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:46:17.130971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:46:17.132817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:17.199410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea07425-1cad-44d5-9aff-3396bbcb1270 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:46:17.203556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:46:17.204235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:17.204554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:17.204835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:17.216202 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:46:17.217712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d65bd-5af3-4bb7-9c15-6a13e0ed76ca service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:46:17.229500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1210/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:46:17.727460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:46:17.729231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:17.741923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bfcf-1efb-488e-b9d2-6ba8a25810cb None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:46:17.747538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:46:17.748459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:17.748813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:17.749126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] PATH_INFO: `/v3/projects/968722ed834a48788b5e6f9bc24b89ec` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:17.750386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968722ed834a48788b5e6f9bc24b89ec)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:46:17.752826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:46:17.808462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:46:17.818051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968722ed834a48788b5e6f9bc24b89ec', 'request_id': 'req-6f21e296-e356-4555-af86-d82b0c10b346'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.828881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968722ed834a48788b5e6f9bc24b89ec', 'request_id': 'req-6f21e296-e356-4555-af86-d82b0c10b346'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.835234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968722ed834a48788b5e6f9bc24b89ec', 'request_id': 'req-6f21e296-e356-4555-af86-d82b0c10b346'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.851331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] The token cache is being invalidate because project 968722ed834a48788b5e6f9bc24b89ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:46:17.851626 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.852341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6f21e296-e356-4555-af86-d82b0c10b346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:46:17.853990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1215/2425] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:46:17 2022] DELETE /identity/v3/projects/968722ed834a48788b5e6f9bc24b89ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:46:27.224834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:46:27.848047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:46:43.862274 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:43.862748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:43.862839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:43.885771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] MFA Rules not processed for user `be0580895be5441d8503d584b33fa954`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:46:43.887024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:43.972345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1211/2426] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:46:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:46:53.552092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:53.552589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:53.552690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:53.570859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:46:53.572079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:53.631881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1216/2427] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:46:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:46:53.685881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:46:53.687745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:46:53.762059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe0b38-e318-45d2-bf90-d7fe82342472 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:46:53.767335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:46:53.767980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:46:53.768260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:46:53.768532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:46:53.776978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:46:53.778588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:46:53.787205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1212/2428] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:47:01.739905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:01.741535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:01.818793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78285b-86d5-45a6-915e-d15b7de99e37 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:01.827628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:01.828557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:01.828842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:01.829117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] PATH_INFO: `/v3/users/7ff9b25139e04764a4fd099a6c72627c` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:01.830331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff9b25139e04764a4fd099a6c72627c)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:01.832360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:01.883052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff9b25139e04764a4fd099a6c72627c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:01.883702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff9b25139e04764a4fd099a6c72627c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:01.891855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff9b25139e04764a4fd099a6c72627c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:01.892551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff9b25139e04764a4fd099a6c72627c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:01.905643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff9b25139e04764a4fd099a6c72627c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:01.918836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1217/2429] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:01 2022] DELETE /identity/v3/users/7ff9b25139e04764a4fd099a6c72627c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:02.099942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:02.111851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e091f1-9d5c-4572-bc05-7a2fda383c21 service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:02.173459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:02.174416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:02.174707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:02.175018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] PATH_INFO: `/v3/projects/f72c3f7b90bb4965865d426b5063cbce` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:02.176275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72c3f7b90bb4965865d426b5063cbce)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:02.178242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:02.219269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:02.230228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72c3f7b90bb4965865d426b5063cbce', 'request_id': 'req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.235931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72c3f7b90bb4965865d426b5063cbce', 'request_id': 'req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.242058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72c3f7b90bb4965865d426b5063cbce', 'request_id': 'req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.259791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] The token cache is being invalidate because project f72c3f7b90bb4965865d426b5063cbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:02.260593 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.261415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.266964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1213/2430] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:02 2022] DELETE /identity/v3/projects/f72c3f7b90bb4965865d426b5063cbce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:02.267523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:02.269060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:02.284523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e2445-d885-469f-8a46-61d5657cfd18 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:02.306449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:02.348859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:02.349757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:02.350059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:02.350583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] PATH_INFO: `/v3/users/f2d0553038d948d4a18766d238644cdd` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:02.352944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d0553038d948d4a18766d238644cdd)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:02.356308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:02.410988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d0553038d948d4a18766d238644cdd'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.411773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d0553038d948d4a18766d238644cdd'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.419622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d0553038d948d4a18766d238644cdd'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.420359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d0553038d948d4a18766d238644cdd'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.434259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d0553038d948d4a18766d238644cdd'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.449473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1218/2431] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:02 2022] DELETE /identity/v3/users/f2d0553038d948d4a18766d238644cdd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:02.644410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:02.646114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:02.665282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e791-9f12-48c9-ad01-9bcf8b84ec5b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:02.745172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:02.746224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:02.746506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:02.746778 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] PATH_INFO: `/v3/projects/495d399d11a846caaa2c604ec7204f8b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:02.748081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=495d399d11a846caaa2c604ec7204f8b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:02.750048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:02.812250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495d399d11a846caaa2c604ec7204f8b', 'request_id': 'req-7e6779b5-6c22-4834-addc-d717cabae66f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.819842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495d399d11a846caaa2c604ec7204f8b', 'request_id': 'req-7e6779b5-6c22-4834-addc-d717cabae66f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.827613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495d399d11a846caaa2c604ec7204f8b', 'request_id': 'req-7e6779b5-6c22-4834-addc-d717cabae66f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.845146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] The token cache is being invalidate because project 495d399d11a846caaa2c604ec7204f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:02.845475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.846219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:02.848196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1214/2432] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:02 2022] DELETE /identity/v3/projects/495d399d11a846caaa2c604ec7204f8b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:12.445292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:12.841515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:12.877889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:12.879627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:12.896071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510f8a-0c87-44d9-bbf8-4f809b12e702 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:12.961696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:12.962606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:12.962889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:12.963198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] PATH_INFO: `/v3/users/0e69fea1eeb5453aa4b09799894b1e7c` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:12.964812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e69fea1eeb5453aa4b09799894b1e7c)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:12.966756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.017817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e69fea1eeb5453aa4b09799894b1e7c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.018758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e69fea1eeb5453aa4b09799894b1e7c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.029063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e69fea1eeb5453aa4b09799894b1e7c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.029961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e69fea1eeb5453aa4b09799894b1e7c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.046286 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-6541454c-190b-4029-87b2-08b20a88fd79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e69fea1eeb5453aa4b09799894b1e7c'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.063109 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1219/2433] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:12 2022] DELETE /identity/v3/users/0e69fea1eeb5453aa4b09799894b1e7c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:13.254474 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.255976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:13.269347 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6779b5-6c22-4834-addc-d717cabae66f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.331131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.332025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.332303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.332576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] PATH_INFO: `/v3/projects/40567f16e35e4007a5349516ea746e40` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.333804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40567f16e35e4007a5349516ea746e40)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.335763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.405733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40567f16e35e4007a5349516ea746e40', 'request_id': 'req-d5c552fd-7a8a-4210-b88f-393fd3449c31'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.411629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40567f16e35e4007a5349516ea746e40', 'request_id': 'req-d5c552fd-7a8a-4210-b88f-393fd3449c31'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.417910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40567f16e35e4007a5349516ea746e40', 'request_id': 'req-d5c552fd-7a8a-4210-b88f-393fd3449c31'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.433431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] The token cache is being invalidate because project 40567f16e35e4007a5349516ea746e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:13.434024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.434680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d5c552fd-7a8a-4210-b88f-393fd3449c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:13.436466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1215/2434] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:13 2022] DELETE /identity/v3/projects/40567f16e35e4007a5349516ea746e40 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:13.441895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.442192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.442475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.461960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:13.463226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:13.527922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1220/2435] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:13.535900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.536192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.536489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.557026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:13.558249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:13.566504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1216/2436] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:13.571949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.582006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bab72-c77e-4e1d-980e-69b19da2ca35 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.586902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.587522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.587822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.588121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.590087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:13.590087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.591305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.603599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1221/2437] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:13.613126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.623354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28329ca-87e9-4123-b839-a9e1f96ab365 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.628452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.629113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.629453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.629722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.630417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.632415 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.660946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1217/2438] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:13 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:47:13.665021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.677522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b19b68-542c-4a84-a102-7b7e0d266a19 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.683205 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:13.739224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.739936 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.740241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.740497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.741198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.743256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.764343 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1222/2439] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:13 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:47:13.768616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.778842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65029-3946-46d8-8ef3-9804f593efd3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.783395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.784185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.784482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.784692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.785402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.787807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.803163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1218/2440] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:13.807557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.818456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9003b-7472-40eb-a35b-8020dc574f78 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.823964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.824800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.825169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.825448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.826192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.827990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01003-934e-4e13-8da1-a49adaee6ca1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.838228 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1223/2441] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:13.843061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:13.854265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebd26-34d5-4fef-ba9c-6c6fb95b0060 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:13.859562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:13.860469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.860756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.861019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] PATH_INFO: `/v3/projects/066c750badd44716b6d081148cfcd734/users/4b200cf5fa204904b8a7a56702b7d70f/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.876538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=066c750badd44716b6d081148cfcd734, user_id=4b200cf5fa204904b8a7a56702b7d70f, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:13.879666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:13.897459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1219/2442] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:13 2022] PUT /identity/v3/projects/066c750badd44716b6d081148cfcd734/users/4b200cf5fa204904b8a7a56702b7d70f/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:13.906315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:13.906645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:13.906875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:13.935009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] MFA Rules not processed for user `4b200cf5fa204904b8a7a56702b7d70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:13.936340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:14.006035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1224/2443] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:14.017145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:14.018985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:14.049804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:14.079011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9532-2e07-44bd-96c5-8a10a94a1eff admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:14.083245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:14.083911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:14.084186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:14.084460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:14.093553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:14.095103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:14.103890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1220/2444] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:18.292972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:18.294659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:18.307458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417b9bf-6bd4-4f51-86d3-bd5106c73582 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:18.311413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:18.312057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:18.312346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:18.312623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:18.314656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:18.396814 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:18.398295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:18.404148 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:18.410043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1225/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:19.877714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:19.879192 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:19.938524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397a43-ec90-4ad5-8436-37e1b9ddf839 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:19.942876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:19.943679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:19.943946 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:19.944221 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:19.946135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:19.960435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:19.961916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4a549-6d67-4504-83be-ab190a445ad7 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:19.973449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1221/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:47:22.663472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:22.729608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941ccb-b7db-48c1-90f0-c49a5c94fea4 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:22.735059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:22.735943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:22.736226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:22.736503 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] PATH_INFO: `/v3/users/4b200cf5fa204904b8a7a56702b7d70f` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:22.737811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b200cf5fa204904b8a7a56702b7d70f)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:22.739799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:22.796776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b200cf5fa204904b8a7a56702b7d70f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:22.797465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b200cf5fa204904b8a7a56702b7d70f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:22.804747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b200cf5fa204904b8a7a56702b7d70f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:22.805396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b200cf5fa204904b8a7a56702b7d70f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:22.817808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b200cf5fa204904b8a7a56702b7d70f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:22.831357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1226/2447] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:22 2022] DELETE /identity/v3/users/4b200cf5fa204904b8a7a56702b7d70f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:22.836177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:22.836698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:22.836793 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:22.855208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:22.856416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:22.916143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1222/2448] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:22.926262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:22.927763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:22.992231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedfe14-e25f-4f58-a9a0-02e4a2d7205a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:22.996463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:22.997118 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:22.997401 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:22.997671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.008225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.009646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32914df-bfe2-4fdd-b2a3-cf410aed085f service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.021818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1227/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:23.300169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.301621 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:23.316122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bdbe-fd20-479a-9a30-608d296d9728 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.321812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.322945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.323227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.323601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] PATH_INFO: `/v3/projects/066c750badd44716b6d081148cfcd734` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.324840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066c750badd44716b6d081148cfcd734)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.326774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.374539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066c750badd44716b6d081148cfcd734', 'request_id': 'req-4e5e3a95-a759-44b6-a725-9786e496e266'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:23.380566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066c750badd44716b6d081148cfcd734', 'request_id': 'req-4e5e3a95-a759-44b6-a725-9786e496e266'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:23.386909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066c750badd44716b6d081148cfcd734', 'request_id': 'req-4e5e3a95-a759-44b6-a725-9786e496e266'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:23.390808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:23.402573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] The token cache is being invalidate because project 066c750badd44716b6d081148cfcd734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:23.403158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:23.404117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-4e5e3a95-a759-44b6-a725-9786e496e266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:23.406039 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1223/2450] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:23 2022] DELETE /identity/v3/projects/066c750badd44716b6d081148cfcd734 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:23.411054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.411178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.411552 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.430988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:23.432217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:23.450751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:23.499611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1228/2451] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:23.507212 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.507505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.507784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.526107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:23.527397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:23.535538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1224/2452] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:23.539790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.549859 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246865-f63f-4014-81e3-8f737b6c9918 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.555297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.555976 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.556262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.556537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.557270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:23.557580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.559227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.572133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1229/2453] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:23.576610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.586877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c4916-9e0a-4340-85f6-e7fbcebc057e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.593185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.593849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.594132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.594407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.595142 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.597103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.628734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1225/2454] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:23.633677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.647336 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8394d7-2f43-4eb6-81a3-4f2ea6f4d11a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.706704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.707420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.707701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.707983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.708676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.710622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.735201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1230/2455] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:23.739669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.750558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df490a8f-081c-41ed-a9ab-3318840ec58b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.756495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.757204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.757487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.757765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.758496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.760151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.771189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1226/2456] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:23.775225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.785627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1985e-ca73-4323-87bb-30e5ccc135ea admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.791071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.791730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.792016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.792276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.793003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.794613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eec43b-84b2-440d-ae1e-9d8f70e20bad admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.805188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1231/2457] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:23.809425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:23.820026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a7eea-943d-4b1f-b927-a14735c54ecf admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:23.825742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:23.826634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.826936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.827231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] PATH_INFO: `/v3/projects/e8f912e794f94bddb95d04824d9f9779/users/a052e5d386904b1c9dabab720fa2c7e9/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.842706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f912e794f94bddb95d04824d9f9779, user_id=a052e5d386904b1c9dabab720fa2c7e9, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:23.845433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:23.859551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1227/2458] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:23 2022] PUT /identity/v3/projects/e8f912e794f94bddb95d04824d9f9779/users/a052e5d386904b1c9dabab720fa2c7e9/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:23.871328 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:23.871624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:23.871902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:23.901546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] MFA Rules not processed for user `a052e5d386904b1c9dabab720fa2c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:23.902866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:23.968838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1232/2459] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:23.973458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.039496 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1637dc-64da-46e1-aae8-c753289b0044 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.044530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.045197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.045481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.045759 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.046456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.048400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.076954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1228/2460] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:23 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:24.082561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.094432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41a2f-1409-405d-a6f2-4c2fb03c370c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.107377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:24.154613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.155317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.155589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.155863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.156551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.158489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.180856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1233/2461] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:24 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:24.185139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.196611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61107bca-774e-453a-a0a5-590b0d3675f0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.201958 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.202622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.202910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.203224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.203948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.205546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.218204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1229/2462] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:24.225022 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.240248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0586ec-2a77-42d8-8e39-972f02ffe390 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.245932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.246843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.247125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.247402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] PATH_INFO: `/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb/users/993242b8177b439a8b08c3110ab2b6a0/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.264582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ad4f58c09b4b68b0b1c177b47222eb, user_id=993242b8177b439a8b08c3110ab2b6a0, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.267752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.289744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1234/2463] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:24 2022] PUT /identity/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb/users/993242b8177b439a8b08c3110ab2b6a0/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:24.296083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.308126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1dcb-2401-4abd-8ac1-c404936c5faf admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.369285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.369992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.370273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.370541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.371441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.373031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0587-f133-4be6-bad4-6c713b4690cb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.383239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1230/2464] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:24.387633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.398536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0ce5-ee12-4ea7-b6a2-f31813f1e14a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.403791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.404724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.405030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.405306 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] PATH_INFO: `/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb/users/993242b8177b439a8b08c3110ab2b6a0/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.407393 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ad4f58c09b4b68b0b1c177b47222eb, user_id=993242b8177b439a8b08c3110ab2b6a0, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.410123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.420974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1235/2465] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:24 2022] PUT /identity/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb/users/993242b8177b439a8b08c3110ab2b6a0/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:24.431967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.432238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.432587 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.441220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:24.464902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] MFA Rules not processed for user `993242b8177b439a8b08c3110ab2b6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:24.466091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:24.535071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1231/2466] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:24.547099 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.550282 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:24.623330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a822e-643b-4e00-881a-ca91ac1ef577 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.627083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.628371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.628669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.628946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.639917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.641400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.652166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1236/2467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:24.702297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:24.703809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:24.717517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43c63-32f1-4c34-9a5e-e12ccc5cd661 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:24.721828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:24.722408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:24.722689 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:24.722993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:24.780349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:24.781789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e4892-1798-471d-beb8-86c922d457e5 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:24.791358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1232/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:28.143810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:28.211857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10beecb-1957-4316-a35f-5e3a7a5a890d service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:28.216622 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:28.217512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:28.217790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:28.218062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] PATH_INFO: `/v3/users/a052e5d386904b1c9dabab720fa2c7e9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:28.219295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a052e5d386904b1c9dabab720fa2c7e9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:28.221249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:28.236010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:28.270745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a052e5d386904b1c9dabab720fa2c7e9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.271731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a052e5d386904b1c9dabab720fa2c7e9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.278601 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a052e5d386904b1c9dabab720fa2c7e9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.279274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a052e5d386904b1c9dabab720fa2c7e9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.291815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a052e5d386904b1c9dabab720fa2c7e9'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.308644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1237/2469] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:28 2022] DELETE /identity/v3/users/a052e5d386904b1c9dabab720fa2c7e9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:28.315006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:28.315503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:28.316031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:28.339338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:28.340545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:28.424420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1233/2470] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:28.435759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:28.438362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:28.500904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7289-ba04-4e26-afbb-bd6d09e920e9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:28.505033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:28.505678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:28.505967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:28.506242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:28.515712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:28.517158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:28.528126 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1238/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:28.840545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:28.841979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:28.859650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fb2f-6a6e-4e7a-8a58-2a33bffeb44c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:28.866235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:28.867223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:28.867523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:28.867757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] PATH_INFO: `/v3/projects/e8f912e794f94bddb95d04824d9f9779` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:28.869071 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f912e794f94bddb95d04824d9f9779)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:28.871083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:28.896827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:28.922748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f912e794f94bddb95d04824d9f9779', 'request_id': 'req-3b506632-0255-40a6-b48d-be838c582541'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.929571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f912e794f94bddb95d04824d9f9779', 'request_id': 'req-3b506632-0255-40a6-b48d-be838c582541'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.936112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f912e794f94bddb95d04824d9f9779', 'request_id': 'req-3b506632-0255-40a6-b48d-be838c582541'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.950239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] The token cache is being invalidate because project e8f912e794f94bddb95d04824d9f9779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:28.950528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.951216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:28.952876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1234/2472] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:28 2022] DELETE /identity/v3/projects/e8f912e794f94bddb95d04824d9f9779 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:28.957939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:28.968270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc24b-149f-4452-9c6d-522cc799c5af service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.028955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.029751 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.030036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.030311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] PATH_INFO: `/v3/users/993242b8177b439a8b08c3110ab2b6a0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.031684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993242b8177b439a8b08c3110ab2b6a0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.033700 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.087046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:29.100480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993242b8177b439a8b08c3110ab2b6a0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.101200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993242b8177b439a8b08c3110ab2b6a0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.108326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993242b8177b439a8b08c3110ab2b6a0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.108969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993242b8177b439a8b08c3110ab2b6a0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.121710 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c7497088-e298-434a-aa79-1c37f4a72610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993242b8177b439a8b08c3110ab2b6a0'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.136183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1239/2473] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:28 2022] DELETE /identity/v3/users/993242b8177b439a8b08c3110ab2b6a0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:29.417820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.419629 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:29.436638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506632-0255-40a6-b48d-be838c582541 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.526807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.527708 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.527995 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.528259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] PATH_INFO: `/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.529460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ad4f58c09b4b68b0b1c177b47222eb)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.531718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.579672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ad4f58c09b4b68b0b1c177b47222eb', 'request_id': 'req-ae42bec0-ef15-4cae-a446-5faa8fa81458'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.585428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ad4f58c09b4b68b0b1c177b47222eb', 'request_id': 'req-ae42bec0-ef15-4cae-a446-5faa8fa81458'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.592048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ad4f58c09b4b68b0b1c177b47222eb', 'request_id': 'req-ae42bec0-ef15-4cae-a446-5faa8fa81458'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.605177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] The token cache is being invalidate because project 86ad4f58c09b4b68b0b1c177b47222eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:29.605472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.606111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae42bec0-ef15-4cae-a446-5faa8fa81458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:29.607728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1235/2474] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:29 2022] DELETE /identity/v3/projects/86ad4f58c09b4b68b0b1c177b47222eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:29.613517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.613990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.614083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.632399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:29.633618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:29.703834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1240/2475] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:29.716522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.716866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.717204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.739440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:29.740666 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:29.751917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1236/2476] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:29.756878 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.767119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714769b-e606-49d0-a9c7-1254cf509c8e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.772888 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.773522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.773829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.774098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.774830 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:29.775173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.776783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.789042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1241/2477] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:29.793473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.803350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6f75a-0be9-43db-a3c4-b5ff4c5b7f1c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.809086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.809767 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.810049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.810323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.811049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.812969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.845411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1237/2478] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:29 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:29.850239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.860440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056fc-745f-4ac8-a6a8-89a7b188a3c8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.921380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.922055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.922331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.922609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.923329 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.925297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.946462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1242/2479] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:29 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:29.950894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.961447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165522c-108b-47a1-b73a-2d86849aaf82 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:29.966324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:29.967019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:29.967303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:29.967571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:29.968292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:29.969924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:29.975425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:29.981487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1238/2480] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:29.985545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:29.996090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8d8a6-880b-4bc5-9a13-49782f30a76b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.001989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.002650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.002955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.003240 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.004004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.005685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f68ff-7584-49ac-b34a-530a5614c7c0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.016462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1243/2481] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:30.021741 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.037182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e54ac2-d16e-4928-b536-abbc0b180c42 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.045871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.047120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.047429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.047783 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] PATH_INFO: `/v3/projects/eb8779cd300f47b4b68cdcfb641b7f12/users/0435c1acf52e447f80e79da0966d62cf/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.064321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8779cd300f47b4b68cdcfb641b7f12, user_id=0435c1acf52e447f80e79da0966d62cf, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.067101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.082247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1239/2482] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:30 2022] PUT /identity/v3/projects/eb8779cd300f47b4b68cdcfb641b7f12/users/0435c1acf52e447f80e79da0966d62cf/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:30.093691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.093981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.094256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.120297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] MFA Rules not processed for user `0435c1acf52e447f80e79da0966d62cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:30.121495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:30.129910 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:30.188013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1244/2483] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:30.192868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.256697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1616f7-fb6e-44ab-ad94-4b0daa5983f6 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.263175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.263841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.264119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.264388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.265083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.267014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.295871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1240/2484] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:30 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:30.300089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.311342 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124781b-d4fd-4973-a251-843de2fd683a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.374179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.374870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.375192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.375477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.376177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.378208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.399712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1245/2485] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:30 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:30.403917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.415127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5d812-8666-46a9-bd8d-8515c71be2b9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.420760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.421394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.421701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.421970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.422698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.424426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.436532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1241/2486] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:30.440757 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.451355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266734d5-370c-4b68-9ac2-db0e6093bb97 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.456829 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.457949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.458233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.458525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] PATH_INFO: `/v3/projects/2d7723e00f6d4dc0b982682b36311031/users/1f23a3a501884ca680d6b89f786c8616/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.475507 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7723e00f6d4dc0b982682b36311031, user_id=1f23a3a501884ca680d6b89f786c8616, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.478164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.492473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1246/2487] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:30 2022] PUT /identity/v3/projects/2d7723e00f6d4dc0b982682b36311031/users/1f23a3a501884ca680d6b89f786c8616/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:30.496554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.506951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed893357-84c9-4b19-b364-455a373d09e4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.565272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.565861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.566350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.566560 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.567297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.568915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dbe3c-55cf-4fae-8787-271978b0f8f5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.578890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1242/2488] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:30.583199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.594995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104c96-904a-4982-81ca-974ea5ca2a58 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.604745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.606255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.606591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.607140 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] PATH_INFO: `/v3/projects/2d7723e00f6d4dc0b982682b36311031/users/1f23a3a501884ca680d6b89f786c8616/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.609283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7723e00f6d4dc0b982682b36311031, user_id=1f23a3a501884ca680d6b89f786c8616, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.612013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.623595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1247/2489] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:30 2022] PUT /identity/v3/projects/2d7723e00f6d4dc0b982682b36311031/users/1f23a3a501884ca680d6b89f786c8616/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:30.634158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.634445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.634711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.662114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] MFA Rules not processed for user `1f23a3a501884ca680d6b89f786c8616`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:30.663426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:30.699819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:30.737678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1243/2490] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:30.748771 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:30.750589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:30.811264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12e6dc-47bf-4a5f-83b2-d11c8f99f9d1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:30.815378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:30.815948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:30.816241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:30.816516 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:30.825956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:30.827434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6636b9-7f0e-4555-a293-8d6fd217952f service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:30.837208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1248/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:30.967942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:31.035703 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c5d6-94e8-4a2e-a7c8-1b5e95e5e0c5 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:31.040677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:31.041549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.041831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.042100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] PATH_INFO: `/v3/users/0435c1acf52e447f80e79da0966d62cf` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.043325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0435c1acf52e447f80e79da0966d62cf)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:31.045262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:31.106077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0435c1acf52e447f80e79da0966d62cf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.121997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0435c1acf52e447f80e79da0966d62cf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.122812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0435c1acf52e447f80e79da0966d62cf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.130717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0435c1acf52e447f80e79da0966d62cf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.139570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0435c1acf52e447f80e79da0966d62cf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.145821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1244/2492] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:30 2022] DELETE /identity/v3/users/0435c1acf52e447f80e79da0966d62cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:31.150607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.150900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.151203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.157937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:31.170062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:31.171311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:31.231625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1249/2493] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:31.241960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:31.243738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:31.302756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed147d-ea67-47c9-aa5f-3267bb143a9d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:31.306950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:31.307616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.307900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.308182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.317091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:31.322412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:31.324049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:31.335636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1245/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:31.625488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:31.627646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:31.641324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f56ae-a5df-437e-9319-7c27176fa1ed None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:31.647389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:31.648356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.648708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.649055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] PATH_INFO: `/v3/projects/eb8779cd300f47b4b68cdcfb641b7f12` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.650420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8779cd300f47b4b68cdcfb641b7f12)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:31.653186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:31.748484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8779cd300f47b4b68cdcfb641b7f12', 'request_id': 'req-c302cccc-0ed0-4eea-921d-d54ef926816f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.769389 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8779cd300f47b4b68cdcfb641b7f12', 'request_id': 'req-c302cccc-0ed0-4eea-921d-d54ef926816f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.787098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8779cd300f47b4b68cdcfb641b7f12', 'request_id': 'req-c302cccc-0ed0-4eea-921d-d54ef926816f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.800969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] The token cache is being invalidate because project eb8779cd300f47b4b68cdcfb641b7f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:31.801288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.801968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-c302cccc-0ed0-4eea-921d-d54ef926816f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.803775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1250/2495] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:31 2022] DELETE /identity/v3/projects/eb8779cd300f47b4b68cdcfb641b7f12 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:31.808819 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:31.821618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2993890-0448-4917-851f-20845b4c55d3 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:31.898972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.899119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.899334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.912100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:31.912999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:31.913308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:31.914060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] PATH_INFO: `/v3/users/1f23a3a501884ca680d6b89f786c8616` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:31.916422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f23a3a501884ca680d6b89f786c8616)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:31.918636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:31.919523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:31.920631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:31.975387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f23a3a501884ca680d6b89f786c8616'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.989110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f23a3a501884ca680d6b89f786c8616'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.989841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f23a3a501884ca680d6b89f786c8616'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:31.994974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1251/2496] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:31.997166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f23a3a501884ca680d6b89f786c8616'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.006739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f23a3a501884ca680d6b89f786c8616'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.009357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.011108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:32.013967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1246/2497] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:31 2022] DELETE /identity/v3/users/1f23a3a501884ca680d6b89f786c8616 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:32.051915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:32.103748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5099f-ad56-418a-9ed0-335568238d29 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.177259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.178058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.178443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.179461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.181511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:32.248970 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.250763 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9306627-3c61-4402-857f-13e202b6924b service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.261529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1252/2498] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 20:47:32.341251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.343033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:32.426525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0176dd0-09e5-4cea-b579-6d15ce8208a5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.431287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.432179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.432463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.432740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] PATH_INFO: `/v3/projects/2d7723e00f6d4dc0b982682b36311031` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.435511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7723e00f6d4dc0b982682b36311031)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.436185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.453983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:32.498057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7723e00f6d4dc0b982682b36311031', 'request_id': 'req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.506750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7723e00f6d4dc0b982682b36311031', 'request_id': 'req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.513715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7723e00f6d4dc0b982682b36311031', 'request_id': 'req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.532461 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] The token cache is being invalidate because project 2d7723e00f6d4dc0b982682b36311031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:32.532762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.533371 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e40a47f6-76ee-4fa1-97d3-3fa513cb170a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:32.535714 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1247/2499] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:32 2022] DELETE /identity/v3/projects/2d7723e00f6d4dc0b982682b36311031 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:32.540842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.541132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.541412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.563353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:32.564746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:32.639002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1253/2500] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:32.646962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.647330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.647672 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.672657 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:32.673992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:32.684770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1248/2501] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:32.688766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.701749 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17f4e6-fedc-451f-8292-a067cf26d60f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.706545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.707267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.707553 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.707837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.708579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:32.708889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.710518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.727179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1254/2502] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:47:32.728659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.739760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c148b-e8c0-424b-9b64-dd2ea1350809 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.747152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.747841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.749317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.749317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.749317 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.751093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.784807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1249/2503] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:32 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:32.786356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.793351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:32.797412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f40a0-b171-4094-9f22-ef09471d4b44 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.869605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.870430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.870802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.871177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.871998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.874010 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.902038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1255/2504] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:32 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:32.906535 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.918974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4a7a8-6cbe-45c7-b74d-3a7975fc6d96 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.924001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.924706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.924990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.925353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.927065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.933823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:32.951987 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1250/2505] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:32.953631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:32.973987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474804-bb64-41fd-9392-c23df60026c2 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:32.991713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:32.992871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:32.993599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:32.994114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:32.994948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:32.996708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcda2f-fc68-4283-a2b7-3bb0573d0aa3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.013350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1256/2506] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:33.014800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.033854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab27b7-0ab2-43d2-a07e-6c055bff7bd2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.040219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.041562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.042429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.042715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] PATH_INFO: `/v3/projects/87c80b1d0008448aae51feef997afb64/users/033be11a6aba44378a0a8c851b329d8f/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.073084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c80b1d0008448aae51feef997afb64, user_id=033be11a6aba44378a0a8c851b329d8f, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.076527 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.114523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1251/2507] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:33 2022] PUT /identity/v3/projects/87c80b1d0008448aae51feef997afb64/users/033be11a6aba44378a0a8c851b329d8f/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:33.115669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.116155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.116590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.155207 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] MFA Rules not processed for user `033be11a6aba44378a0a8c851b329d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:33.156471 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:33.229352 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1257/2508] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:33.234130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.311080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b2481-4e11-4e42-9671-486a7361e6cd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.314443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.315196 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.315476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.315754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.316736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.318704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.349354 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1252/2509] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:33 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:47:33.354192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.366497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765ba1e-5b2d-43a3-b110-e78bbe00be82 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.434252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.436446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.436756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.437032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.437738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.439759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.468176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1258/2510] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:33 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:33.472328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.484414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c07e5-4de8-4d8e-a559-cae2f3d63bf9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.489353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.490090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.490530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.490807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.491630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.493297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.511002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1253/2511] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:33.519092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.525051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:33.532599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40801db-47f5-41b2-b9b4-83d90e4c61d6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.540733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.541703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.541990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.542267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] PATH_INFO: `/v3/projects/6068a750834549a9b7cad1a3e45c57c2/users/af722dd3460e4a419493c91aba6af008/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.560168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6068a750834549a9b7cad1a3e45c57c2, user_id=af722dd3460e4a419493c91aba6af008, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.563576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.582760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1259/2512] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:33 2022] PUT /identity/v3/projects/6068a750834549a9b7cad1a3e45c57c2/users/af722dd3460e4a419493c91aba6af008/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:33.586798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.599780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30d60-957c-47cd-86fc-9f8605c28004 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.609875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:33.681854 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.682794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.682900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.683125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.683929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.685557 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b6f7f-0583-4f66-ab20-4fa6fd7e4b04 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.698251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1254/2513] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:33.702202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.713302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c946c7-0972-440c-be1c-f3968bef4c36 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:33.731822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:33.733054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.733341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.733624 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] PATH_INFO: `/v3/projects/6068a750834549a9b7cad1a3e45c57c2/users/af722dd3460e4a419493c91aba6af008/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.737693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6068a750834549a9b7cad1a3e45c57c2, user_id=af722dd3460e4a419493c91aba6af008, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:33.741054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:33.754368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1260/2514] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:33 2022] PUT /identity/v3/projects/6068a750834549a9b7cad1a3e45c57c2/users/af722dd3460e4a419493c91aba6af008/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:33.764095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:33.764493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:33.764871 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:33.796257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] MFA Rules not processed for user `af722dd3460e4a419493c91aba6af008`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:33.798036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:33.888845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1255/2515] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:33.902409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:33.904190 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:33.999115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438eac8-4771-4a32-b0e9-b5b429461a77 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:34.003595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:34.004466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:34.004817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:34.005163 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:34.074430 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:34.075924 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71444d54-66b5-4dab-a0e6-f591cad715c3 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:34.089433 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1261/2516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:36.773372 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:36.859765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a334b-8c96-45fa-b283-3012f444a8fb None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:36.865508 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:36.869096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:36.869096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:36.869096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] PATH_INFO: `/v3/users/033be11a6aba44378a0a8c851b329d8f` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:36.870386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033be11a6aba44378a0a8c851b329d8f)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:36.872459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:36.929375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:36.941389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033be11a6aba44378a0a8c851b329d8f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:36.960336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033be11a6aba44378a0a8c851b329d8f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:36.961175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033be11a6aba44378a0a8c851b329d8f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:36.969300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033be11a6aba44378a0a8c851b329d8f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:36.979387 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033be11a6aba44378a0a8c851b329d8f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:36.988696 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1256/2517] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:36 2022] DELETE /identity/v3/users/033be11a6aba44378a0a8c851b329d8f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:36.993452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:36.993933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:36.994144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:37.014832 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:37.016238 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:37.099136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1262/2518] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:37.109957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:37.111478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:37.190730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c374664-b1c7-4923-bf1f-9d53ca4a8b34 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:37.195047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:37.195890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:37.196349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:37.196781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:37.212174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:37.214351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:37.227988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1257/2519] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:37.561857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:37.563833 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:37.580479 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c28d8-cb22-4364-9fb4-47d699c26fa8 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:37.590981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:37.592049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:37.592332 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:37.592681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] PATH_INFO: `/v3/projects/87c80b1d0008448aae51feef997afb64` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:37.594113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c80b1d0008448aae51feef997afb64)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:37.596206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:37.621555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:37.662881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c80b1d0008448aae51feef997afb64', 'request_id': 'req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.674546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c80b1d0008448aae51feef997afb64', 'request_id': 'req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.682630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c80b1d0008448aae51feef997afb64', 'request_id': 'req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.703056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] The token cache is being invalidate because project 87c80b1d0008448aae51feef997afb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:37.703056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.703618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.705454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1263/2520] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:37 2022] DELETE /identity/v3/projects/87c80b1d0008448aae51feef997afb64 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:37.712453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:37.727076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7861f72-e171-499a-897f-40b2ee44f5e1 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:37.821061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:37.821730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:37.822019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:37.822452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] PATH_INFO: `/v3/users/af722dd3460e4a419493c91aba6af008` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:37.823993 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af722dd3460e4a419493c91aba6af008)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:37.826291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:37.891075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af722dd3460e4a419493c91aba6af008'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.907412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:37.916160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af722dd3460e4a419493c91aba6af008'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.917965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af722dd3460e4a419493c91aba6af008'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.934449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af722dd3460e4a419493c91aba6af008'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.941679 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af722dd3460e4a419493c91aba6af008'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:37.953715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1258/2521] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:37 2022] DELETE /identity/v3/users/af722dd3460e4a419493c91aba6af008 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:38.287537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:38.289906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.325634 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:38.325789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6b487-9dbc-4ed0-a521-d7ecd547007e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:38.327781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.404679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:38.405669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.406006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.406251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] PATH_INFO: `/v3/projects/6068a750834549a9b7cad1a3e45c57c2` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.407486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6068a750834549a9b7cad1a3e45c57c2)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:38.409674 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:38.427579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd601-1bd9-4d6c-8130-5a96bcd41778 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:38.433720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:38.434618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.435154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.435618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.438318 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.477750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6068a750834549a9b7cad1a3e45c57c2', 'request_id': 'req-a6318b13-cef4-4281-a851-46add0bcfb34'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:38.494199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6068a750834549a9b7cad1a3e45c57c2', 'request_id': 'req-a6318b13-cef4-4281-a851-46add0bcfb34'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:38.501134 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6068a750834549a9b7cad1a3e45c57c2', 'request_id': 'req-a6318b13-cef4-4281-a851-46add0bcfb34'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:38.513023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:38.514754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218bad0-8b00-4022-8468-8a445cf8c40a service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:38.517406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] The token cache is being invalidate because project 6068a750834549a9b7cad1a3e45c57c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:38.517899 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:38.518722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a6318b13-cef4-4281-a851-46add0bcfb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:38.521437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1264/2522] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:38 2022] DELETE /identity/v3/projects/6068a750834549a9b7cad1a3e45c57c2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:38.526324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1259/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:38.531295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.531646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.531939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.703931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:38.705089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.742002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:38.786397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1265/2524] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:38.794506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.794875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.795534 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.824103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:38.826724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.837930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1260/2525] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:38.843105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:38.858586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551535a-6e2a-45bb-8174-35134d78970f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:38.867611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:38.868357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.868705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.868979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.869804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:38.870113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:38.872233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:38.888437 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1266/2526] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:38.892853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:38.919915 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db362f3-084c-4f94-a4c1-a068f8f7797c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:38.932624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:38.937711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:38.938000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:38.943449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:38.944652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:38.944822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:38.947423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:38.947562 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.014754 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1261/2527] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:47:39.019473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:39.092432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf6233-2d63-47d2-854d-e12c30a5454b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.104162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:39.127275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9ec72-ff00-486a-a1e4-087a72cba4c5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.132722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.133410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.133695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.134029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.134730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.136763 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.161585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1262/2528] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:39 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:47:39.165692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:39.176702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60bfef-0793-4ca0-a346-9b08ce7217b3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.182092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.182804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.183110 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.183388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.184140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.186019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.194414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.195400 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.195846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.196269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.197602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1263/2529] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:39.198485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:39.202025 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:39.216285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837194-bab3-42a6-b9ec-ab4bb91ed7a9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.221632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.222472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.222835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.223247 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.224151 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.225983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.242300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1264/2530] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:39.245368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:39.262413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da74-d6a8-44f2-853e-e9fb38f6fa78 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.268789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.270546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.270978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.271400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] PATH_INFO: `/v3/projects/bb98141cec87424494e443ec06ac4b88/users/c33f264153594e0f913307269f832749/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.280617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:39.284270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.288120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631de5c8-c177-4a81-bdfa-ea159374e730 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.301357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb98141cec87424494e443ec06ac4b88, user_id=c33f264153594e0f913307269f832749, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.304422 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.306776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1267/2531] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:39.332021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1265/2532] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:39 2022] PUT /identity/v3/projects/bb98141cec87424494e443ec06ac4b88/users/c33f264153594e0f913307269f832749/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:39.343896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.343896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.343896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.376488 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] MFA Rules not processed for user `c33f264153594e0f913307269f832749`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:39.377941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:39.503472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1268/2533] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:39.513396 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:39.515353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:39.609364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2befb-b7cb-4390-9d76-62370be53486 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:39.615267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:39.616428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:39.616943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:39.617191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:39.632785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:39.634542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff47daf-d5b7-427b-b4b6-da3c3794465a service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:39.644842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1266/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:47:43.066965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:43.134486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9719-2cef-4592-9d73-8332b42a00be None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:43.138853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:43.139759 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.140035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.140306 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] PATH_INFO: `/v3/users/c33f264153594e0f913307269f832749` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.141487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33f264153594e0f913307269f832749)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:43.143432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:43.194033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33f264153594e0f913307269f832749'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.194725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33f264153594e0f913307269f832749'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.201559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33f264153594e0f913307269f832749'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.202222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33f264153594e0f913307269f832749'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.214305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33f264153594e0f913307269f832749'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.229056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1269/2535] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:43 2022] DELETE /identity/v3/users/c33f264153594e0f913307269f832749 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:43.233906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.234448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.234591 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.253413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:43.254705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:43.316040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1267/2536] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:43.327337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:43.328937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:43.336061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:43.390031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b745b4-271d-437d-8338-9edd644b8e84 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:43.393823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:43.394468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.394753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.395086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.404525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:43.406642 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0fa5f-075a-4f6f-9e62-a64cb0c316b4 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:43.416964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1270/2537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:43.699914 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:43.701341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:43.713588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575aaea-e282-429e-860b-89c7d741fcba None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:43.720281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:43.721599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.722018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.722434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] PATH_INFO: `/v3/projects/bb98141cec87424494e443ec06ac4b88` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.724333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb98141cec87424494e443ec06ac4b88)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:43.727480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:43.765766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:43.784335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb98141cec87424494e443ec06ac4b88', 'request_id': 'req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.791137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb98141cec87424494e443ec06ac4b88', 'request_id': 'req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.797612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb98141cec87424494e443ec06ac4b88', 'request_id': 'req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.811894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] The token cache is being invalidate because project bb98141cec87424494e443ec06ac4b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:43.812178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.812827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7aabb0bf-a3e5-41d5-8300-d9770fc8e1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:43.814460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1268/2538] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:43 2022] DELETE /identity/v3/projects/bb98141cec87424494e443ec06ac4b88 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:43.819596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.819890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.820162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.839517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:43.840747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:43.906517 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1271/2539] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:43.914445 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.914733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.915050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.934816 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:43.936074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:43.945786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1269/2540] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:43.952925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:43.969515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e159cf-c762-4ef7-a31f-e487cd8baa34 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:43.977474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:43.978145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:43.978429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:43.978703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:43.979457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:43.979764 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:43.981384 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:43.994359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1272/2541] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:43.998799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.008253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773fdeb-9214-4483-89f2-907e3ccfdcf8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.013745 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.014577 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.014855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.015157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.015848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.017791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.052865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1270/2542] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:43 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:44.058144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.072436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac2f14-3152-4cd9-8821-128d0d0f8b9a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.134873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.135623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.135904 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.136177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.136956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.138961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.162427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1273/2543] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:44 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:44.167169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.179267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e9421-b01c-4bd3-add7-56cb180239d4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.184307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.184999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.185284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.185566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.186310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.188010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.199507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1271/2544] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:44.204120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.214697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a75ec-ff63-4493-87ed-29e087eefc72 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.219702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.220380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.220664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.220940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.221678 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.223386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7f78-244a-4f0a-bff6-6b540b974a58 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.234181 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1274/2545] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:44.238344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.252130 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3c9e5-7156-4c51-965d-b9a72a039ebd admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.259132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.260066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.260352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.260630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] PATH_INFO: `/v3/projects/fed6f79e7a164bd1a1f247d50a20205f/users/758ba3aa90d648e7906e3c5b919e5c95/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.275645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed6f79e7a164bd1a1f247d50a20205f, user_id=758ba3aa90d648e7906e3c5b919e5c95, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.278368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.293435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1272/2546] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:44 2022] PUT /identity/v3/projects/fed6f79e7a164bd1a1f247d50a20205f/users/758ba3aa90d648e7906e3c5b919e5c95/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:44.304760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0d6a-3c05-419d-9637-a56f2947f753 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.305053 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0d6a-3c05-419d-9637-a56f2947f753 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.305335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0d6a-3c05-419d-9637-a56f2947f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.329079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:44.331949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c19f0d6a-3c05-419d-9637-a56f2947f753 None None] MFA Rules not processed for user `758ba3aa90d648e7906e3c5b919e5c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:44.334054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c19f0d6a-3c05-419d-9637-a56f2947f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:44.400693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1275/2547] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:44.413135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:44.415027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:44.484614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb22af4-d76d-4732-b7ea-7aa41acb264a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:44.489952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:44.490290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:44.490580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:44.491043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:44.500971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:44.502442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbecccc-6b79-4d5b-9666-64cebde5ae7b service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:44.525661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1273/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:46.386231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.386740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.386860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.388485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1276/2549] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:47:46.402242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd756-f943-4cda-abab-3658c38859fd None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.402828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd756-f943-4cda-abab-3658c38859fd None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.402971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd756-f943-4cda-abab-3658c38859fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.428648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b7dfd756-f943-4cda-abab-3658c38859fd None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:46.430082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b7dfd756-f943-4cda-abab-3658c38859fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:46.502896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:46.533821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1274/2550] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:46.548442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:46.550341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:46.612651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce41e8e-3af3-4de4-99be-5e97d49bbaf2 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:46.617493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:46.618144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.626963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.626963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.631120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:46.632574 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1679d1-cfa8-4b2c-97ed-addf9693a1b9 service glance] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:46.644036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1277/2551] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:46.716680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.716969 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.717250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] PATH_INFO: `/` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.718762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1275/2552] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:47:46.724072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859bf7-a419-4b5e-8758-c212d9c6dddf None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.724476 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859bf7-a419-4b5e-8758-c212d9c6dddf None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.724837 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859bf7-a419-4b5e-8758-c212d9c6dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.744807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d6859bf7-a419-4b5e-8758-c212d9c6dddf None None] MFA Rules not processed for user `455761927d084f3893b404776f8dd9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:46.746164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d6859bf7-a419-4b5e-8758-c212d9c6dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:46.808222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1278/2553] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:46.820678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:46.822896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:46.838275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a23d-54f6-422a-aba1-ee182c55e714 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:46.842730 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:46.843413 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.843695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.843967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.852243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:46.853649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3e38-6d55-4592-b7a2-765b8b2df4b6 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:46.861936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1276/2554] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:46.947361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafc4c-4950-4fcb-93e0-2113900efc95 None None] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.947697 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafc4c-4950-4fcb-93e0-2113900efc95 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.947974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aafc4c-4950-4fcb-93e0-2113900efc95 None None] PATH_INFO: `/` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.949456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1279/2555] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 13 20:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 20:47:46.954863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32313de-258c-4dac-9fe4-85874708650c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:46.955182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32313de-258c-4dac-9fe4-85874708650c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:46.955458 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32313de-258c-4dac-9fe4-85874708650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:46.975101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c32313de-258c-4dac-9fe4-85874708650c None None] MFA Rules not processed for user `8eebb29015984c98a0c6867dcb03fd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:46.976954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c32313de-258c-4dac-9fe4-85874708650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:46.987882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1277/2556] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 13 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:46.998695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aafc4c-4950-4fcb-93e0-2113900efc95 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:47.011367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aafc4c-4950-4fcb-93e0-2113900efc95 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:47.016167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:47.017201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:47.017482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:47.017754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:47.029550 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:47.031035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:47.042537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1280/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:47.109186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32313de-258c-4dac-9fe4-85874708650c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:47.110873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c32313de-258c-4dac-9fe4-85874708650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:47.179729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32313de-258c-4dac-9fe4-85874708650c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:47.186234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:47.186823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:47.187018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:47.187290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:47.189098 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:47.201041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:47.202711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec29ebd-9660-4ed6-96cb-fa90f38a480c service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:47.214374 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1278/2558] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:48.152905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:48.156355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:48.174966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef3979-f634-4b51-b87a-d82b6386f439 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:48.179826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:48.180675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:48.181027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:48.181395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:48.183435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:48.193844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:48.195344 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:48.203582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1281/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:49.399645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:49.400154 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:49.400249 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:49.420403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:49.421802 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:49.483673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1279/2560] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 13 20:47:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:49.496203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:49.497808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:49.532337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=100 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:49.576103 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84e18c-c726-49c2-86e1-e2531a6a4571 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:49.581733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:49.582380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:49.582813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:49.583219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:49.592246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:49.593831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:49.603288 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1282/2561] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 20:47:53.455719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:53.475525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b83b8e-2f80-455f-bc41-a015dabaa567 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:53.483262 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:53.484978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:53.485420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:53.486774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:53.489342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:53.567034 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:53.572530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:53.574174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:53.586344 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1280/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:57.938649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:57.940151 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:57.956138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc57934-d36e-423e-adf3-eb06a5e96ac3 service swift] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:57.960798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:57.962001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:57.962291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:57.962569 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] PATH_INFO: `/v3/users/be0580895be5441d8503d584b33fa954` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:57.964165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0580895be5441d8503d584b33fa954)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:57.966094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.019153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0580895be5441d8503d584b33fa954'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.020289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0580895be5441d8503d584b33fa954'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.028042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0580895be5441d8503d584b33fa954'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.028779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0580895be5441d8503d584b33fa954'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.042512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9e0cbbb8-5bb1-4d8a-8e9f-a031b9e2f0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0580895be5441d8503d584b33fa954'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.058448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1283/2563] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:57 2022] DELETE /identity/v3/users/be0580895be5441d8503d584b33fa954 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:58.249367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.260222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8975ed5-524b-465f-8756-0349bca211d8 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.319820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.320701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.320999 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.321267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] PATH_INFO: `/v3/projects/4d01ade2b091447296e58eae444f32f9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.322497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d01ade2b091447296e58eae444f32f9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.324431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.377194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d01ade2b091447296e58eae444f32f9', 'request_id': 'req-ae7036ef-2d8c-4888-91ca-5800c99a2700'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.382781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d01ade2b091447296e58eae444f32f9', 'request_id': 'req-ae7036ef-2d8c-4888-91ca-5800c99a2700'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.389088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d01ade2b091447296e58eae444f32f9', 'request_id': 'req-ae7036ef-2d8c-4888-91ca-5800c99a2700'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.403198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] The token cache is being invalidate because project 4d01ade2b091447296e58eae444f32f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:47:58.403487 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.404160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-ae7036ef-2d8c-4888-91ca-5800c99a2700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:58.405777 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1281/2564] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:58 2022] DELETE /identity/v3/projects/4d01ade2b091447296e58eae444f32f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:58.411095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.411609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.411897 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.432230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:58.433454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:58.499188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1284/2565] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:47:58.507804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.508099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.508381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.528234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:58.529488 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:58.538492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1282/2566] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:58.543261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.554434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be459a7-6cbd-47f8-baef-3961ca98f00e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.559929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.560595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.560874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.561145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.561879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:47:58.562183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.563948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.577077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1285/2567] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:47:58.581755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.591779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b61392-d42f-4f2a-b904-49035ea3ab73 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.596936 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.597611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.597897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.598543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.598886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.600881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.631424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1283/2568] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:47:58 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:58.635475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.646101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8bc4-1395-46f2-84a5-75c299df4a8a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.668823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:58.713543 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.714568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.714844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.715145 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.715838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.717767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.740889 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1286/2569] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:47:58 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:47:58.745311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.755940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f822-e07b-4f25-a8db-5433a2d3e17d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.761285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.761928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.762210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.762483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.763239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.764942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.776493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1284/2570] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:58.782229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.793629 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e884865-7fa3-45ec-99d2-b95818590018 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.799399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.800069 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.800358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.800635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.801551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.803690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c13da-bb9c-455f-a741-8a283ee528b8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.817120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1287/2571] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:47:58.821614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:58.833060 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486b816-a110-4d81-a23c-7831cb1ce519 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:58.838027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:58.839368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.839648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.839919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] PATH_INFO: `/v3/projects/1d5d4d08af194a8f980c367ce22672b0/users/23aee84ee1b24e81b06acd8a483450d7/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.856861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5d4d08af194a8f980c367ce22672b0, user_id=23aee84ee1b24e81b06acd8a483450d7, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:58.860029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:58.874510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1285/2572] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:47:58 2022] PUT /identity/v3/projects/1d5d4d08af194a8f980c367ce22672b0/users/23aee84ee1b24e81b06acd8a483450d7/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:47:58.886250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:58.886542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:58.887077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:58.919337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] MFA Rules not processed for user `23aee84ee1b24e81b06acd8a483450d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:58.920429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:58.989728 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1288/2573] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:59.001307 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:59.003351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:59.029029 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:59.091447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a2800-c0fe-4e04-a503-605c7d91b1d2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:59.097426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:59.098265 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:59.098553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:59.098833 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:59.107500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:59.109111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3f03-d2dd-4702-98f8-e1059835939d service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:59.117981 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1286/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:59.321595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:59.392926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc741ff0-16f5-4879-824e-dd1e95ad5b89 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:59.398518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:59.399434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:59.399717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:59.399995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] PATH_INFO: `/v3/users/23aee84ee1b24e81b06acd8a483450d7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:59.401237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23aee84ee1b24e81b06acd8a483450d7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:59.403206 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:59.437713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:47:59.461372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23aee84ee1b24e81b06acd8a483450d7'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:59.462049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23aee84ee1b24e81b06acd8a483450d7'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:59.469372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23aee84ee1b24e81b06acd8a483450d7'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:59.470323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23aee84ee1b24e81b06acd8a483450d7'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:59.485523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23aee84ee1b24e81b06acd8a483450d7'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:47:59.500392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1289/2575] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:47:59 2022] DELETE /identity/v3/users/23aee84ee1b24e81b06acd8a483450d7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:47:59.505282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:59.505775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:59.505888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:59.525209 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:47:59.526540 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:59.596084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1287/2576] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:47:59.606025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:59.607587 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:47:59.669872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458f317-8ea7-4aba-90b8-d9a7f9680be0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:47:59.673849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:47:59.674560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:47:59.674848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:47:59.675229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:47:59.684852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:47:59.686318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363b66f-bffb-4137-bacd-d7cd05a2139a service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:47:59.696594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1290/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:47:59.995959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:47:59.997886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:00.011515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c34e6b-b439-4456-9a06-ea80bb9024e3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.016539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.017431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.017734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.018008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] PATH_INFO: `/v3/projects/1d5d4d08af194a8f980c367ce22672b0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.019231 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5d4d08af194a8f980c367ce22672b0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.021257 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.216146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5d4d08af194a8f980c367ce22672b0', 'request_id': 'req-bf534ecc-4751-48bd-a2d1-2797686291d4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:00.225175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5d4d08af194a8f980c367ce22672b0', 'request_id': 'req-bf534ecc-4751-48bd-a2d1-2797686291d4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:00.232161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5d4d08af194a8f980c367ce22672b0', 'request_id': 'req-bf534ecc-4751-48bd-a2d1-2797686291d4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:00.246330 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] The token cache is being invalidate because project 1d5d4d08af194a8f980c367ce22672b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:00.246635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:00.247277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-bf534ecc-4751-48bd-a2d1-2797686291d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:00.249085 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1288/2578] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:47:59 2022] DELETE /identity/v3/projects/1d5d4d08af194a8f980c367ce22672b0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:00.256235 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.256691 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.256805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.278331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:00.279726 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:00.346024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1291/2579] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:00.354409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82651-acd4-4131-9856-aec822048842 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.355114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82651-acd4-4131-9856-aec822048842 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.355114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82651-acd4-4131-9856-aec822048842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.373910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-49f82651-acd4-4131-9856-aec822048842 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:00.375220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-49f82651-acd4-4131-9856-aec822048842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:00.383671 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1289/2580] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:00.387962 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.397722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53b032-933d-4d4e-849b-eb9da896b9e6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.404562 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.405248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.405536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.405820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.406560 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:00.406867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.409110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.421513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1292/2581] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:00.426008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f82651-acd4-4131-9856-aec822048842 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.437020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f82651-acd4-4131-9856-aec822048842 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.445013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.445677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.445956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.446225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.446910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.448839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.473049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:00.480420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1290/2582] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:00.484823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.497253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99379993-5c78-4a9a-b07c-eec020923b2d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.535915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:00.572224 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.572827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.573113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.573388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.574088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.576125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.601039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1293/2583] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:00.605127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.616111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba6e5b-542b-4a1c-b62d-23a9b0c5ca6c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.621899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.622579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.622889 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.623179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.623920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.625523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.636662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1291/2584] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:00.641453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.652208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27704d-7414-456f-87ff-e5fa6f27c1c4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.656967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.657631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.657918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.658196 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.658907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.661334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3a98-3605-4034-a0a1-a5e91082ad12 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.672491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1294/2585] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:00.676796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.687724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9111c-5dfc-42f7-8e35-38fb91ea4edb admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.693136 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.694179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.694449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.694728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] PATH_INFO: `/v3/projects/909fd177af6c4d06b3814a98b4823e03/users/0675327382204bca9a18f842f65ed2b9/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.710083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=909fd177af6c4d06b3814a98b4823e03, user_id=0675327382204bca9a18f842f65ed2b9, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.712799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.728046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1292/2586] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:00 2022] PUT /identity/v3/projects/909fd177af6c4d06b3814a98b4823e03/users/0675327382204bca9a18f842f65ed2b9/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:00.738452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.738941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.739252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.769341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] MFA Rules not processed for user `0675327382204bca9a18f842f65ed2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:00.771262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:00.846114 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1295/2587] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:00.851403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.922271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73976f79-82a2-4e18-b0a2-6bd6762a17bf admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:00.927963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:00.928627 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:00.928906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:00.929175 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:00.929844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:00.931817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:00.966652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1293/2588] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:00.971001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:00.982395 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c770d4-fb91-426f-9f3f-ee60c08dd29c None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.044341 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.045027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.045312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.045591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.046305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.048423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.069800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1296/2589] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:01.075586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:01.087333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98312032-8d9d-4533-96da-a64f89a9089f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.092998 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.093996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.094285 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.094558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.095335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.096937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.107602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1294/2590] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:01.112036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:01.123570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c94a-a1da-439a-9ce4-0815a58fc955 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.128909 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.130019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.130357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.130658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] PATH_INFO: `/v3/projects/4dadcb07ac1c427383a6dc0923b387e9/users/09afda4b67494e0ba858985b04a2aefa/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.146681 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dadcb07ac1c427383a6dc0923b387e9, user_id=09afda4b67494e0ba858985b04a2aefa, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.151214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.165079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1297/2591] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:01 2022] PUT /identity/v3/projects/4dadcb07ac1c427383a6dc0923b387e9/users/09afda4b67494e0ba858985b04a2aefa/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:01.169331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:01.180105 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f690fb7-66ad-4e8f-823a-a0b03e864cea admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.240688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.241770 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.242024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.242296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.243158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.244829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7d20-2ea2-45f3-ac4b-a3c730f2b62a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.255985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1295/2592] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:48:01.260504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:01.271989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ef4a-5ca4-404a-baf5-9fb510e36d81 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.277707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.278630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.279084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.279388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] PATH_INFO: `/v3/projects/4dadcb07ac1c427383a6dc0923b387e9/users/09afda4b67494e0ba858985b04a2aefa/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.281692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dadcb07ac1c427383a6dc0923b387e9, user_id=09afda4b67494e0ba858985b04a2aefa, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.284670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.288189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:01.298504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1298/2593] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:01 2022] PUT /identity/v3/projects/4dadcb07ac1c427383a6dc0923b387e9/users/09afda4b67494e0ba858985b04a2aefa/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:01.310012 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.310304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.310585 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.339603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] MFA Rules not processed for user `09afda4b67494e0ba858985b04a2aefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:01.340839 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:01.366654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:01.418945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1296/2594] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:01.430893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:01.432920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:01.500494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d5974-25e1-4ea9-a189-9bc2fbfcfc90 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:01.503999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:01.504711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:01.505030 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:01.505236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:01.515268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:01.516718 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a351a2-6e1e-40e9-b033-d1cf5bff9ef6 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:01.526305 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1299/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:01.937140 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:02.007049 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdf1f9-1e10-44f2-8298-afd5be83cd1a None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:02.011614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:02.012529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:02.012809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:02.013078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] PATH_INFO: `/v3/users/0675327382204bca9a18f842f65ed2b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:02.014599 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0675327382204bca9a18f842f65ed2b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:02.016311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:02.091311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0675327382204bca9a18f842f65ed2b9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.105450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0675327382204bca9a18f842f65ed2b9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.106190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0675327382204bca9a18f842f65ed2b9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.113095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0675327382204bca9a18f842f65ed2b9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.122748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0675327382204bca9a18f842f65ed2b9'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.129358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1297/2596] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:01 2022] DELETE /identity/v3/users/0675327382204bca9a18f842f65ed2b9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:02.134972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:02.135398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:02.135925 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:02.157008 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:02.158326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:02.274100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1300/2597] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:02.285498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:02.288342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:02.337528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:02.355442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ff1e-53ee-493a-9655-eb0644c1913a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:02.360490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:02.361189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:02.361466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:02.361809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:02.372174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:02.373659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:02.383569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1298/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:02.726079 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:02.727663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:02.740872 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c369-5982-454b-ac76-8f2051f5b4e5 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:02.746631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:02.747672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:02.748019 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:02.748301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] PATH_INFO: `/v3/projects/909fd177af6c4d06b3814a98b4823e03` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:02.749573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909fd177af6c4d06b3814a98b4823e03)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:02.751651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:02.810088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909fd177af6c4d06b3814a98b4823e03', 'request_id': 'req-836e3fcc-a510-4883-a2fe-f3eed9524847'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.819800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909fd177af6c4d06b3814a98b4823e03', 'request_id': 'req-836e3fcc-a510-4883-a2fe-f3eed9524847'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.826018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909fd177af6c4d06b3814a98b4823e03', 'request_id': 'req-836e3fcc-a510-4883-a2fe-f3eed9524847'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.838491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] The token cache is being invalidate because project 909fd177af6c4d06b3814a98b4823e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:02.839157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.839913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:02.841565 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1301/2599] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:02 2022] DELETE /identity/v3/projects/909fd177af6c4d06b3814a98b4823e03 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:02.845937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:02.857404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754d1d1-698a-4b50-9cac-efcfa5c4b152 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:02.921201 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:02.922117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:02.922425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:02.922695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] PATH_INFO: `/v3/users/09afda4b67494e0ba858985b04a2aefa` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:02.923944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09afda4b67494e0ba858985b04a2aefa)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:02.925853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:02.993342 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09afda4b67494e0ba858985b04a2aefa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.006417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09afda4b67494e0ba858985b04a2aefa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.007250 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09afda4b67494e0ba858985b04a2aefa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.014579 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09afda4b67494e0ba858985b04a2aefa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.023943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-d0fc747a-86ad-4d10-babc-6e5e5125a9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09afda4b67494e0ba858985b04a2aefa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.030841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1299/2600] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:02 2022] DELETE /identity/v3/users/09afda4b67494e0ba858985b04a2aefa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:48:03.323961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.325567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:03.341708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3fcc-a510-4883-a2fe-f3eed9524847 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.363038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:03.409246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.410082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.410366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.410813 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] PATH_INFO: `/v3/projects/4dadcb07ac1c427383a6dc0923b387e9` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.412021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dadcb07ac1c427383a6dc0923b387e9)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.414006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.468803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dadcb07ac1c427383a6dc0923b387e9', 'request_id': 'req-58f1d4d2-1953-4693-9639-080a9d21c4e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.480708 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dadcb07ac1c427383a6dc0923b387e9', 'request_id': 'req-58f1d4d2-1953-4693-9639-080a9d21c4e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.488231 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dadcb07ac1c427383a6dc0923b387e9', 'request_id': 'req-58f1d4d2-1953-4693-9639-080a9d21c4e2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.500081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] The token cache is being invalidate because project 4dadcb07ac1c427383a6dc0923b387e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:03.500468 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.501371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-58f1d4d2-1953-4693-9639-080a9d21c4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:03.502980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1302/2601] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:03 2022] DELETE /identity/v3/projects/4dadcb07ac1c427383a6dc0923b387e9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:03.508393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.508775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.509059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.527161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:03.528447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:03.590812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1300/2602] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:03.599379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.599634 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.599943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.619870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:03.621101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:03.631514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1303/2603] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:03.636469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.643851 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:03.650795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990069-1e7b-4b6d-9054-c9136ff591ef None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.656976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.658051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.658352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.658612 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.659444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:03.659713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.661436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.675126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1301/2604] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:48:03.679589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.689630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717650f-7bd4-4908-a647-a9bb61f767ae None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.695636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.696312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.696767 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.697039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.697730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.699658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.729486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1304/2605] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:03.731974 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.742414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741ca1-9061-42dc-9f3a-1e3d6d774048 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.801273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.802270 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.802558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.802837 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.803590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.805571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.831174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1302/2606] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:03.832607 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.843989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae909-5924-4c7d-9457-096512dd0073 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.850692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.851398 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.851685 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.851952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.852690 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.854308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.866377 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1305/2607] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:48:03.870601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.881571 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fec95-5669-4f5a-bc27-34706749fad5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.886835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.887567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.887853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.888131 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.888873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.890480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854c17-1bb4-4487-9448-109a783eace5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.902256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1303/2608] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:03.906491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:03.917567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87951d27-9e83-418e-9abe-e921f4bac902 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:03.924559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:03.925509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.925802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.926170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] PATH_INFO: `/v3/projects/afefd0dce5134c5f852f16fad914445b/users/baf4efad4c0e4b77ac41c8ead88565e1/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.944900 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afefd0dce5134c5f852f16fad914445b, user_id=baf4efad4c0e4b77ac41c8ead88565e1, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:03.947675 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d930-85e4-4b88-8ac9-b9b871dbe1f5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:03.956606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.956886 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.957226 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.963465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1306/2609] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:03 2022] PUT /identity/v3/projects/afefd0dce5134c5f852f16fad914445b/users/baf4efad4c0e4b77ac41c8ead88565e1/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:03.977003 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:03.977291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:03.977568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:03.982495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] MFA Rules not processed for user `4dce5ff2de9342969b39fca8578fca98`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:03.983917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:04.004340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] MFA Rules not processed for user `baf4efad4c0e4b77ac41c8ead88565e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:04.005598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:04.045489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1304/2610] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:04.046473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:04.070134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.071775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:04.078692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1307/2611] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:04.083212 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.144490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102779-3933-48f7-a5a0-c862e641f258 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.148455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01464652-924b-4700-bea7-c8e58f4cd6d1 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.149652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '588e6f0b3d6a452ea8a197cc6930dc60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.150336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.150624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.150904 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.153693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.154367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.154650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.154946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.155649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.157627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.161744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.163397 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.171866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1305/2612] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 13 20:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 20:48:04.191116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1308/2613] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:04 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:04.192293 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.197781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:04.204935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664991e-a52b-4cc9-8869-6950ae91d1ce service swift] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.267086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.267811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.268096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.268369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.269078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.271091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.292742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1306/2614] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:04 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:04.296783 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.308935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb1fbd-83f1-4f5a-b0af-3491dec3ce01 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.313816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.314563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.314847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.315172 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.316004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.318156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.330270 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1309/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:04.334169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.345067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9ac4-88da-4d2e-8b7e-12b3f3e3ce59 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.350234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.351168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.351453 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.351728 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] PATH_INFO: `/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3/users/8f7d4b9bedb24abb99af4984cdc8b45e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.369260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a87dc34c2684386b02d2f5b0bfcf4f3, user_id=8f7d4b9bedb24abb99af4984cdc8b45e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.371996 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.388687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1307/2616] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:04 2022] PUT /identity/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3/users/8f7d4b9bedb24abb99af4984cdc8b45e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:04.391709 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.403706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f412e25-2ed7-417d-9ac4-4bf27e17b839 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.466869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.467612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.467961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.468256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.469132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.470739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e55ff5-7fb9-49a6-b70a-e5af8bf456b5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.481509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1310/2617] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:04.485964 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.496985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7474-5b49-4d2f-bfe6-8e8e723e599c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.501547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.502434 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.502712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.503021 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] PATH_INFO: `/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3/users/8f7d4b9bedb24abb99af4984cdc8b45e/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.505349 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a87dc34c2684386b02d2f5b0bfcf4f3, user_id=8f7d4b9bedb24abb99af4984cdc8b45e, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.508000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.518910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1308/2618] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:04 2022] PUT /identity/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3/users/8f7d4b9bedb24abb99af4984cdc8b45e/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:04.531000 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.531394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.531777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.560218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] MFA Rules not processed for user `8f7d4b9bedb24abb99af4984cdc8b45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:04.561451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:04.603923 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:04.636155 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1311/2619] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:48:04.647801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:04.649717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:04.717048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631a88-2515-4626-a2fe-abc374d436c0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:04.720892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:04.721565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:04.721858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:04.722141 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:04.732328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:04.733789 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb362ea-b384-4ff3-994f-9fe28d58c5d8 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:04.744840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1309/2620] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:05.201171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:05.266775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92e26-2185-41cd-b95c-0907d76c8759 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:05.271960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:05.272868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:05.273165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:05.273429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] PATH_INFO: `/v3/users/baf4efad4c0e4b77ac41c8ead88565e1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:05.274746 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf4efad4c0e4b77ac41c8ead88565e1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:05.276725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:05.336542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf4efad4c0e4b77ac41c8ead88565e1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.337229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf4efad4c0e4b77ac41c8ead88565e1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.344704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf4efad4c0e4b77ac41c8ead88565e1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.345404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf4efad4c0e4b77ac41c8ead88565e1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.358209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf4efad4c0e4b77ac41c8ead88565e1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.374407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1312/2621] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:05 2022] DELETE /identity/v3/users/baf4efad4c0e4b77ac41c8ead88565e1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:05.379291 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:05.379831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:05.379831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:05.398350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:05.399973 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:05.455948 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:05.468790 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1310/2622] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:05.478784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:05.480487 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:05.542135 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0422dea-93a2-450c-9443-74ef6fe3f5d3 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:05.545939 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:05.546645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:05.546940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:05.547239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:05.555429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:05.558713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:05.560733 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:05.573071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1313/2623] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:05.884400 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:05.885903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:05.900751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001de171-c548-416c-8ffa-c3b75ac13955 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:05.906477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:05.907389 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:05.907675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:05.907942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] PATH_INFO: `/v3/projects/afefd0dce5134c5f852f16fad914445b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:05.909233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afefd0dce5134c5f852f16fad914445b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:05.911319 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:05.961960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afefd0dce5134c5f852f16fad914445b', 'request_id': 'req-3185ae66-93b1-4331-aae4-16ba251afee4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.967894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afefd0dce5134c5f852f16fad914445b', 'request_id': 'req-3185ae66-93b1-4331-aae4-16ba251afee4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.974558 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afefd0dce5134c5f852f16fad914445b', 'request_id': 'req-3185ae66-93b1-4331-aae4-16ba251afee4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.990329 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] The token cache is being invalidate because project afefd0dce5134c5f852f16fad914445b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:05.990614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.991236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:05.992909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1311/2624] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:05 2022] DELETE /identity/v3/projects/afefd0dce5134c5f852f16fad914445b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:05.997001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.008380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982416c-bca4-403b-8664-a5994a48bf80 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.074611 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.075653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.075995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.076275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] PATH_INFO: `/v3/users/8f7d4b9bedb24abb99af4984cdc8b45e` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.077540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7d4b9bedb24abb99af4984cdc8b45e)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:06.079567 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:06.129059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7d4b9bedb24abb99af4984cdc8b45e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.129776 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7d4b9bedb24abb99af4984cdc8b45e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.137414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7d4b9bedb24abb99af4984cdc8b45e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.138160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7d4b9bedb24abb99af4984cdc8b45e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.151625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-3a8481bc-2898-48c7-a6f0-add522209b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7d4b9bedb24abb99af4984cdc8b45e'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.167372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1314/2625] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:05 2022] DELETE /identity/v3/users/8f7d4b9bedb24abb99af4984cdc8b45e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:06.465641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.467273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:06.483393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185ae66-93b1-4331-aae4-16ba251afee4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.546234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.547148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.547435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.547711 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] PATH_INFO: `/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.548920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a87dc34c2684386b02d2f5b0bfcf4f3)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:06.551682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:06.603184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a87dc34c2684386b02d2f5b0bfcf4f3', 'request_id': 'req-56b570cc-6352-4376-bac5-4a428f5ac4e6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.608609 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a87dc34c2684386b02d2f5b0bfcf4f3', 'request_id': 'req-56b570cc-6352-4376-bac5-4a428f5ac4e6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.614791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a87dc34c2684386b02d2f5b0bfcf4f3', 'request_id': 'req-56b570cc-6352-4376-bac5-4a428f5ac4e6'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.631171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] The token cache is being invalidate because project 7a87dc34c2684386b02d2f5b0bfcf4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:06.631438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.632158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-56b570cc-6352-4376-bac5-4a428f5ac4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:06.633774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1312/2626] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:06 2022] DELETE /identity/v3/projects/7a87dc34c2684386b02d2f5b0bfcf4f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:06.639243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.639752 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.639864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.660358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:06.679458 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:06.735696 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1315/2627] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:06.744234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.744561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.744806 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.764403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:06.765640 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:06.774457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1313/2628] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:06.778871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.789474 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270365-aebf-47e4-b0c7-de461caa6358 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.794725 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.795413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.795694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.795954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.796704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:06.796987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:06.798592 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:06.811682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1316/2629] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:06.816410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.822193 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:06.825906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d03ec-c715-42cd-8799-22940c49ffd9 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.832683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.833392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.833675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.833950 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.834683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:06.836847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:06.866716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1314/2630] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:06 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:06.871045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.876214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:06.883842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e5847-1d34-4c6a-9489-df5f79ad0f7b admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.946304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.947246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:06.947706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:06.948054 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:06.949068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:06.951218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:06.978654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1317/2631] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:06 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:06.983184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:06.994511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b61e-26cb-4bae-b150-bb42c00907c9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:06.999241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:06.999906 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.000191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.000471 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.001200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.002812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.013880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1315/2632] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:07.019302 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.030444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81ac5a-9e22-4dbc-9173-a6cc1699dcc7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.035280 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.035955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.036245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.036519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.037246 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.038875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7dde2-fa39-4776-aa45-f98f62b51b35 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.049961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1318/2633] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:07.054299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.065288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b124-f53a-4673-94c7-a2b7264b2fba admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.071620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.072518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.072799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.073073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] PATH_INFO: `/v3/projects/4e7e708cfbb54fec8fb96461acb07e2d/users/b49512ced24c4b37be06ef87cfb2a2db/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.089124 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e708cfbb54fec8fb96461acb07e2d, user_id=b49512ced24c4b37be06ef87cfb2a2db, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.091866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.106297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1316/2634] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:07 2022] PUT /identity/v3/projects/4e7e708cfbb54fec8fb96461acb07e2d/users/b49512ced24c4b37be06ef87cfb2a2db/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:07.117788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.118078 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.118353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.148317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] MFA Rules not processed for user `b49512ced24c4b37be06ef87cfb2a2db`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:07.150071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:07.220693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1319/2635] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:07.225549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.303036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c924d5-2de1-4ac2-8dd8-e0b52b9f7bd9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.312179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.313123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.313464 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.313832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.314900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.317652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.348241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1317/2636] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:07 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:07.352409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.363427 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892d09a-0dec-4d71-b2af-102659ab134f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.421295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.421891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.422177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.422455 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.423183 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.425127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.441750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:07.448737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1320/2637] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:07 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:07.452467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.464339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5defe-0e6b-48cc-b39f-0994aa8a8280 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.469339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.470145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.470437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.470715 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.471492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.473177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.485224 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1318/2638] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:07.489692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.500111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34588a9-1b35-4325-a3a4-73c37781ef7c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.504799 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.505694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.505981 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.506261 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] PATH_INFO: `/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc/users/c0001ccfa0dd4f6998e76a072f397f43/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.521480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77d98ec46724db69cc1fc822bf1d9dc, user_id=c0001ccfa0dd4f6998e76a072f397f43, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.524223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.538407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1321/2639] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:07 2022] PUT /identity/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc/users/c0001ccfa0dd4f6998e76a072f397f43/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:07.542375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.552443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cede74-d460-4e30-98a3-69db1f864ab8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.614390 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.615106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.615386 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.615659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.616384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.618005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1a2fe-595e-4838-a0f7-9cef82112963 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.628641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1319/2640] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:07.633210 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.645346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc946cc0-f4c7-4306-86a6-dcc3be6765cf admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.650693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.651613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.652013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.652299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] PATH_INFO: `/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc/users/c0001ccfa0dd4f6998e76a072f397f43/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.654695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77d98ec46724db69cc1fc822bf1d9dc, user_id=c0001ccfa0dd4f6998e76a072f397f43, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.657277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.671009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1322/2641] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:07 2022] PUT /identity/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc/users/c0001ccfa0dd4f6998e76a072f397f43/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:07.681928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.682256 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.682603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.709385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] MFA Rules not processed for user `c0001ccfa0dd4f6998e76a072f397f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:07.710674 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:07.716081 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:07.785438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1320/2642] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:07.796359 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.798373 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:07.857084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eca7aa-92b9-40b9-8407-073a0acd7b96 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.861544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.862204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.862484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.862762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:07.872789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:07.874255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:07.883992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1323/2643] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:07.983497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:07.993545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11912eca-3024-4512-a6d0-d961a3f6b9f8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:07.997584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:07.998235 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:07.998512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:07.998788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:08.057016 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:08.058455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154a4e5-f0e6-41cc-91ac-32da1ba0053f service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:08.067502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1321/2644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:10.686809 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:10.754863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58462b94-967d-446a-b7f9-5e836ddba8ad service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:10.759652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:10.760535 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:10.760848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:10.761129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] PATH_INFO: `/v3/users/b49512ced24c4b37be06ef87cfb2a2db` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:10.762349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49512ced24c4b37be06ef87cfb2a2db)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:10.764617 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:10.820750 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49512ced24c4b37be06ef87cfb2a2db'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:10.821431 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49512ced24c4b37be06ef87cfb2a2db'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:10.829855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49512ced24c4b37be06ef87cfb2a2db'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:10.830541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49512ced24c4b37be06ef87cfb2a2db'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:10.845358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:10.852792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49512ced24c4b37be06ef87cfb2a2db'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:10.866790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1324/2645] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:10 2022] DELETE /identity/v3/users/b49512ced24c4b37be06ef87cfb2a2db => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:10.871704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:10.872328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:10.872328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:10.890401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:10.891678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:10.951011 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1322/2646] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:10.961105 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:10.962627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:11.027402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356e678-c919-426c-9232-1335b49b8d21 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:11.032040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:11.032684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:11.032967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:11.033215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:11.044012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:11.045466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:11.056537 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1325/2647] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:11.340191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:11.341601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:11.354189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6406-459b-437b-a688-70abdf9a9cbe None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:11.358880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:11.359827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:11.360067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:11.360338 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] PATH_INFO: `/v3/projects/4e7e708cfbb54fec8fb96461acb07e2d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:11.362156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7e708cfbb54fec8fb96461acb07e2d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:11.366862 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:11.409814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:11.419852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7e708cfbb54fec8fb96461acb07e2d', 'request_id': 'req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.426931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7e708cfbb54fec8fb96461acb07e2d', 'request_id': 'req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.433108 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7e708cfbb54fec8fb96461acb07e2d', 'request_id': 'req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.446852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] The token cache is being invalidate because project 4e7e708cfbb54fec8fb96461acb07e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:11.447168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.447792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.449336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1323/2648] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:11 2022] DELETE /identity/v3/projects/4e7e708cfbb54fec8fb96461acb07e2d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:11.453420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:11.465092 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2287220-b2f2-4291-b1ab-8eea7ad1bc1d service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:11.523071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:11.523943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:11.524219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:11.524491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] PATH_INFO: `/v3/users/c0001ccfa0dd4f6998e76a072f397f43` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:11.525671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0001ccfa0dd4f6998e76a072f397f43)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:11.527849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:11.577953 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0001ccfa0dd4f6998e76a072f397f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.578671 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0001ccfa0dd4f6998e76a072f397f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.586204 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0001ccfa0dd4f6998e76a072f397f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.586843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0001ccfa0dd4f6998e76a072f397f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.600599 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d1031d9e-8fe7-4469-a184-ba38ef974f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0001ccfa0dd4f6998e76a072f397f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:11.619203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1326/2649] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:11 2022] DELETE /identity/v3/users/c0001ccfa0dd4f6998e76a072f397f43 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:11.912455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:11.913926 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:11.927692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c88dc-bd3c-4dc8-8865-2feb08f3234c admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:11.995532 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:11.996394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:11.996773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:11.997062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] PATH_INFO: `/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:11.998266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77d98ec46724db69cc1fc822bf1d9dc)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.000322 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.055865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77d98ec46724db69cc1fc822bf1d9dc', 'request_id': 'req-96fcf316-da0f-480e-a146-c8a0780b32fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:12.061567 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77d98ec46724db69cc1fc822bf1d9dc', 'request_id': 'req-96fcf316-da0f-480e-a146-c8a0780b32fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:12.068181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77d98ec46724db69cc1fc822bf1d9dc', 'request_id': 'req-96fcf316-da0f-480e-a146-c8a0780b32fe'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:12.081751 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] The token cache is being invalidate because project b77d98ec46724db69cc1fc822bf1d9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:12.082087 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:12.082779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-96fcf316-da0f-480e-a146-c8a0780b32fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:12.084602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1324/2650] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:11 2022] DELETE /identity/v3/projects/b77d98ec46724db69cc1fc822bf1d9dc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:12.090315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.090954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.090954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.104146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:12.110273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:12.112021 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:12.176406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1327/2651] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:12.184953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.184953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.185157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.204863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:12.206099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:12.214810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1325/2652] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:48:12.219291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.230198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad15a9-9055-4a04-a135-91d2d9c229b6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.235525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.236191 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.236524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.236798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.237539 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:12.237843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.239541 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.251311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1328/2653] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 20:48:12.256465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.265952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b282fe-a71f-4529-b7da-ff3e8002ac52 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.272401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.273055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.273336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.273614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.274295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.276228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.308732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1326/2654] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:12.313096 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.323573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59afd38-284d-4a47-9301-8cf5544e03b3 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.392203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.392802 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.393088 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.393361 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.394047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.396061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.418160 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1329/2655] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/users => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:12.424505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.441014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b1bee-dbe7-46db-af15-f8ac0fee38eb admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.447251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.447943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.448229 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.448512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.449654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.451375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.463442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1327/2656] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:12.470165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.481747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aeca8-0f01-4ea1-9f8b-f7dfd4a9fb8c admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.487394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.488046 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.488327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.488595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.489310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.490905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c178f-6365-4b86-a3a5-2000491dfe92 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.501931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1330/2657] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:12.506509 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.516719 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706d73c-2bc3-480f-851f-4a6640dc57b3 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.521709 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.522556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.522835 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.523134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] PATH_INFO: `/v3/projects/6a2205f1c9434f5e986fbe76039533a1/users/b877f6afa44444d98c99770ec6469973/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.536061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:12.539545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2205f1c9434f5e986fbe76039533a1, user_id=b877f6afa44444d98c99770ec6469973, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.542546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.558411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1328/2658] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:12 2022] PUT /identity/v3/projects/6a2205f1c9434f5e986fbe76039533a1/users/b877f6afa44444d98c99770ec6469973/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:12.570056 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.570323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.570628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.601004 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] MFA Rules not processed for user `b877f6afa44444d98c99770ec6469973`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:12.602258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:12.668149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1331/2659] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:12.674530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.746510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455fb45-f9ea-4534-993d-02252ea3c1d2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.751495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.752331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.752716 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.753090 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.753882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.756813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.788584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1329/2660] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:12.792689 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.798898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:12.806659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fed8e-68d5-44c8-82b9-7f4b80e25e4a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.865637 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.866314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.866687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.866991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.867682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.869614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.890672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1332/2661] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:12 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:12.894909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.905923 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff4a1-603c-4782-96da-059dcbf5d953 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.910755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.911654 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.911867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.912143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.912894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.914539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.925951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1330/2662] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:12.930402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.941744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c970-b98d-4d5a-9cae-1c5200a744b4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:12.947738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:12.948730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:12.949018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:12.949322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] PATH_INFO: `/v3/projects/1255a17aa9d2454598b59fb7a1c904b9/users/3084d4b670b74c8786a9b80b5897a82f/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:12.965649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1255a17aa9d2454598b59fb7a1c904b9, user_id=3084d4b670b74c8786a9b80b5897a82f, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:12.968357 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:12.984002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1333/2663] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:12 2022] PUT /identity/v3/projects/1255a17aa9d2454598b59fb7a1c904b9/users/3084d4b670b74c8786a9b80b5897a82f/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:48:12.988727 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:12.999428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e06fc-d7df-4178-b310-fe0bbd0549a8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:13.056094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:13.056761 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:13.057040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:13.057314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:13.058038 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:13.059662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249a5b-2a62-4a14-8ce0-e2b9ed8fd2af admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:13.074340 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1331/2664] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:13.075351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:13.086024 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a7a9-096e-4415-962d-8579004d1924 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:13.091227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:13.092223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:13.092511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:13.092787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] PATH_INFO: `/v3/projects/1255a17aa9d2454598b59fb7a1c904b9/users/3084d4b670b74c8786a9b80b5897a82f/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:13.094820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1255a17aa9d2454598b59fb7a1c904b9, user_id=3084d4b670b74c8786a9b80b5897a82f, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:13.097475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:13.109748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1334/2665] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:13 2022] PUT /identity/v3/projects/1255a17aa9d2454598b59fb7a1c904b9/users/3084d4b670b74c8786a9b80b5897a82f/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:13.120758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:13.121050 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:13.121325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:13.153556 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] MFA Rules not processed for user `3084d4b670b74c8786a9b80b5897a82f`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:13.154910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:13.206099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:13.231677 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1332/2666] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:13.243521 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:13.245850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:13.312307 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb54e6-afc9-4299-8524-94677698c3b8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:13.316115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:13.316791 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:13.317320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:13.317706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:13.327906 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:13.329419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:13.340438 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1335/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:13.497205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:13.508956 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3e10-b6a9-4e34-aa50-909c5928dd4b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:13.513381 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:13.514043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:13.514325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:13.514597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:13.576238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:13.577681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24adf1-1c50-4a32-a13a-9a5fc34cef4d service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:13.587268 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1333/2668] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:15.369796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:15.371912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:15.435717 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:15.440494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa226a-e1f2-4500-b6c8-e30d00a655ca service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:15.447178 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:15.448061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:15.448347 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:15.448625 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] PATH_INFO: `/v3/users/758ba3aa90d648e7906e3c5b919e5c95` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:15.449842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=758ba3aa90d648e7906e3c5b919e5c95)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:15.452278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:15.510852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758ba3aa90d648e7906e3c5b919e5c95'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:15.511891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758ba3aa90d648e7906e3c5b919e5c95'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:15.521652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758ba3aa90d648e7906e3c5b919e5c95'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:15.522884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758ba3aa90d648e7906e3c5b919e5c95'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:15.539716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758ba3aa90d648e7906e3c5b919e5c95'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:15.554662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1336/2669] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:15 2022] DELETE /identity/v3/users/758ba3aa90d648e7906e3c5b919e5c95 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:15.559554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:15.560055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:15.560153 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:15.578402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:15.579619 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:15.656717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1334/2670] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:15.666907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:15.668439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:15.726954 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f773a9-efa2-487b-ac3a-17fb1b32f6e3 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:15.731465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:15.732139 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:15.732423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:15.732703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:15.742715 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:15.744202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a0287-7338-4756-81e2-399876b21fa7 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:15.753793 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1337/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:16.042009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.043565 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:16.059651 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca161f-b7cd-403e-a5ca-022bf3eac200 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.065691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.066800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.067477 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.067826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] PATH_INFO: `/v3/projects/fed6f79e7a164bd1a1f247d50a20205f` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.069441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed6f79e7a164bd1a1f247d50a20205f)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.071583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.128872 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed6f79e7a164bd1a1f247d50a20205f', 'request_id': 'req-118ea682-f15c-4a9c-bace-c16f78db3074'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:16.135628 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed6f79e7a164bd1a1f247d50a20205f', 'request_id': 'req-118ea682-f15c-4a9c-bace-c16f78db3074'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:16.141888 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed6f79e7a164bd1a1f247d50a20205f', 'request_id': 'req-118ea682-f15c-4a9c-bace-c16f78db3074'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:16.156251 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] The token cache is being invalidate because project fed6f79e7a164bd1a1f247d50a20205f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:16.156541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:16.157234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-118ea682-f15c-4a9c-bace-c16f78db3074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:16.158991 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1335/2672] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:16 2022] DELETE /identity/v3/projects/fed6f79e7a164bd1a1f247d50a20205f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:16.164299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.164930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.164930 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.186216 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:16.187466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:16.249320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1338/2673] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:16.257680 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd656-3497-410d-967f-98811091492f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.257965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd656-3497-410d-967f-98811091492f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.258253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd656-3497-410d-967f-98811091492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.277503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-fe8fd656-3497-410d-967f-98811091492f None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:16.278830 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-fe8fd656-3497-410d-967f-98811091492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:16.287345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1336/2674] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:48:16.291571 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.301784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da7d3d-989f-4d7d-9f07-d057b7fc5166 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.307551 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.308513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.308963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.309405 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.310731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:16.311242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.313946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.328722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1339/2675] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:16.333526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd656-3497-410d-967f-98811091492f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.338007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:16.345044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd656-3497-410d-967f-98811091492f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.354897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.355729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.355857 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.356133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.356825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.358725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.386164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1337/2676] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:16 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:16.390366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.400338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f8eae-b20c-4ee7-81b2-6cd6fe063e56 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.404106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:16.460442 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.461229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.461692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.461874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.462711 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.465444 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.489005 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1340/2677] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:16 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:16.493661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.504385 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695cb56-26d8-4f3d-802e-43c080be09f5 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.512145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.512145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.512145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.512145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.512523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.516512 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.527855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1338/2678] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:16.532041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.542257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db95b1-659d-4a26-983a-1559ace775f5 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.547217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.547911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.548188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.548467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.549218 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.550815 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84df9f6-fa0b-4a03-85fe-6a5d96c6b5b3 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.562051 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1341/2679] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:16.566882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.578079 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d027d-d63b-4d32-8cf4-c9e433564257 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.583424 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.584325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.584606 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.584887 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] PATH_INFO: `/v3/projects/a1d1a16bd6064eedb63a67cd8a3bc83b/users/95dd7c55ae78443f9f15781c8c64d9d2/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.602236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d1a16bd6064eedb63a67cd8a3bc83b, user_id=95dd7c55ae78443f9f15781c8c64d9d2, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.605001 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.620076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1339/2680] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:16 2022] PUT /identity/v3/projects/a1d1a16bd6064eedb63a67cd8a3bc83b/users/95dd7c55ae78443f9f15781c8c64d9d2/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:16.630902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.631250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.631547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.658803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] MFA Rules not processed for user `95dd7c55ae78443f9f15781c8c64d9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:16.660048 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:16.730138 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1342/2681] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:16.741559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:16.743504 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:16.800852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90d8d3-0f8f-4a4c-bf92-bfdf6773895d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:16.805248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:16.805967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:16.806228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:16.806517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:16.815407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:16.816881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2f4d7-85f5-4e77-9bb0-1f9299509af5 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:16.825738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1340/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:18.923493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:18.925337 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:18.997683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1b41f-7abb-4bb0-b7d1-1c757cb9acad None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:19.002591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:19.003513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:19.003818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:19.004089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] PATH_INFO: `/v3/users/b877f6afa44444d98c99770ec6469973` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:19.005632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b877f6afa44444d98c99770ec6469973)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:19.007648 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:19.024009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:19.060219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b877f6afa44444d98c99770ec6469973'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.060931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b877f6afa44444d98c99770ec6469973'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.068547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b877f6afa44444d98c99770ec6469973'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.069264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b877f6afa44444d98c99770ec6469973'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.081927 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b877f6afa44444d98c99770ec6469973'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.097961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1343/2683] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:18 2022] DELETE /identity/v3/users/b877f6afa44444d98c99770ec6469973 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:19.104511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:19.105020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:19.105126 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:19.123502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:19.124713 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:19.190774 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1341/2684] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:19.201346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:19.202856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:19.265419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2d1-9b5a-4e8d-be1e-dc14cfa0f4e8 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:19.272264 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:19.273225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:19.273621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:19.273995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:19.290564 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:19.292876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:19.308836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1344/2685] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:19.598056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:19.599548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:19.616337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896cd6-b8b2-43af-a313-4868f26d3862 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:19.622115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:19.623096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:19.623448 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:19.623795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] PATH_INFO: `/v3/projects/6a2205f1c9434f5e986fbe76039533a1` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:19.625336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2205f1c9434f5e986fbe76039533a1)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:19.627267 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:19.684409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:19.689119 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2205f1c9434f5e986fbe76039533a1', 'request_id': 'req-7d710100-7910-42f2-995b-ca3b07452e94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.696254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2205f1c9434f5e986fbe76039533a1', 'request_id': 'req-7d710100-7910-42f2-995b-ca3b07452e94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.702561 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2205f1c9434f5e986fbe76039533a1', 'request_id': 'req-7d710100-7910-42f2-995b-ca3b07452e94'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.716431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] The token cache is being invalidate because project 6a2205f1c9434f5e986fbe76039533a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:19.716638 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.717287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.718880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1342/2686] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:19 2022] DELETE /identity/v3/projects/6a2205f1c9434f5e986fbe76039533a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:19.723111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:19.733142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec3ae-9587-4788-8d8b-5f84387b8d27 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:19.795193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:19.797234 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:19.797534 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:19.797820 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] PATH_INFO: `/v3/users/3084d4b670b74c8786a9b80b5897a82f` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:19.799120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3084d4b670b74c8786a9b80b5897a82f)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:19.801049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:19.843285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:19.851789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3084d4b670b74c8786a9b80b5897a82f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.852731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3084d4b670b74c8786a9b80b5897a82f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.859991 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3084d4b670b74c8786a9b80b5897a82f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.860677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3084d4b670b74c8786a9b80b5897a82f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.872243 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b48293c0-8822-4e6e-bba1-acd573d58689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3084d4b670b74c8786a9b80b5897a82f'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:19.888378 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1345/2687] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:19 2022] DELETE /identity/v3/users/3084d4b670b74c8786a9b80b5897a82f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:20.179283 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.180742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:20.195418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710100-7910-42f2-995b-ca3b07452e94 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.254100 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.254865 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.255195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.255459 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] PATH_INFO: `/v3/projects/1255a17aa9d2454598b59fb7a1c904b9` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.256812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1255a17aa9d2454598b59fb7a1c904b9)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.258724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.305336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1255a17aa9d2454598b59fb7a1c904b9', 'request_id': 'req-e5a50527-4a48-498c-849d-b4602355490b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:20.311269 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1255a17aa9d2454598b59fb7a1c904b9', 'request_id': 'req-e5a50527-4a48-498c-849d-b4602355490b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:20.317416 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1255a17aa9d2454598b59fb7a1c904b9', 'request_id': 'req-e5a50527-4a48-498c-849d-b4602355490b'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:20.330779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] The token cache is being invalidate because project 1255a17aa9d2454598b59fb7a1c904b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:20.331134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:20.331845 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e5a50527-4a48-498c-849d-b4602355490b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:20.333483 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1343/2688] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:20 2022] DELETE /identity/v3/projects/1255a17aa9d2454598b59fb7a1c904b9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:20.339903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.340382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.340497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.358419 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:20.359660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:20.429965 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1346/2689] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:20.438189 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.438457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.438736 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.457630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:20.459048 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:20.468652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1344/2690] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:20.472881 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.483451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8e7f-6d80-4edf-84ce-9a27417e1d27 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.489027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.489687 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.490020 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.490299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.491076 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:20.491387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.493002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.505107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1347/2691] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:20.509506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.519388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f2b3a-8941-48ca-9ea3-847fd09dadb1 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.524980 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.525635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.525937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.526210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.526893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.528849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.558881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1345/2692] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:20 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:20.563123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.574161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2a6b5-8c8c-4b65-86bb-8c9b0b63a549 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.636917 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.637580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.637866 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.638136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.638816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.640792 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.664836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1348/2693] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:20 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:20.668986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.680023 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a11f-bb29-4516-81a6-5d46d0fdfc7b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.684952 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.685614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.685894 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.686170 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.686899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.688515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.699723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1346/2694] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:20.703944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.714960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24ce89-2571-40f3-b951-3f99a37fd892 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.719989 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.720658 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.720946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.721226 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.721957 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.723613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd94d-6351-4297-ad1a-0f12f6f4cb83 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.734229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1349/2695] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:20.738409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.753610 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26f23-e98d-42f7-adda-1b58e6f73deb admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:20.760261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:20.761078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.761362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.761639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] PATH_INFO: `/v3/projects/b824d9ef4e29468189d2088e563997a1/users/4e9edfeeed814f338561ad0bd0b986f4/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.777432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b824d9ef4e29468189d2088e563997a1, user_id=4e9edfeeed814f338561ad0bd0b986f4, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:20.780132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:20.789796 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:20.796304 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1347/2696] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:20 2022] PUT /identity/v3/projects/b824d9ef4e29468189d2088e563997a1/users/4e9edfeeed814f338561ad0bd0b986f4/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:20.863153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:20.863519 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:20.863861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:20.897491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] MFA Rules not processed for user `4e9edfeeed814f338561ad0bd0b986f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:20.898701 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:20.908540 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:20.971440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1350/2697] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:20.986399 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:20.989366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:21.050909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5df9-0297-4a86-8139-d735f2e4635a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:21.055460 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4379a727a73403487d9a3adc342a06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:21.056106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:21.056367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:21.056646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:21.066517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:21.067984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cdd22-904d-4468-a754-8ffd02a20b3c service glance] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:21.077636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1348/2698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:26.934303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:26.936774 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.021969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c907308-bccc-418c-be86-4d66e2f2302f None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:27.027879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:27.028762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.029047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.029310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] PATH_INFO: `/v3/users/95dd7c55ae78443f9f15781c8c64d9d2` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.030738 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95dd7c55ae78443f9f15781c8c64d9d2)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:27.032703 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:27.093043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95dd7c55ae78443f9f15781c8c64d9d2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.094068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95dd7c55ae78443f9f15781c8c64d9d2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.102112 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95dd7c55ae78443f9f15781c8c64d9d2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.102831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95dd7c55ae78443f9f15781c8c64d9d2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.118822 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95dd7c55ae78443f9f15781c8c64d9d2'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.135323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1351/2699] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:26 2022] DELETE /identity/v3/users/95dd7c55ae78443f9f15781c8c64d9d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:27.140055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.140596 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.140698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.158158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:27.159383 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.235743 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1349/2700] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:27.245884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:27.247510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.285754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:27.313549 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b4cde-da9e-4764-beb4-9b108e5bb708 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:27.317334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:27.317993 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.318279 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.318573 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.328871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:27.330324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9941e6-78b7-4ef6-8c05-af309b4126cc service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:27.340227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1352/2701] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:27.629924 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:27.632182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.649242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542d2f-7dd0-4014-9295-31eae9ad80ec None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:27.654160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:27.656502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.656978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.657259 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] PATH_INFO: `/v3/projects/a1d1a16bd6064eedb63a67cd8a3bc83b` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.658875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d1a16bd6064eedb63a67cd8a3bc83b)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:27.661198 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:27.715086 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d1a16bd6064eedb63a67cd8a3bc83b', 'request_id': 'req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.720686 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d1a16bd6064eedb63a67cd8a3bc83b', 'request_id': 'req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.726967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d1a16bd6064eedb63a67cd8a3bc83b', 'request_id': 'req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.742505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] The token cache is being invalidate because project a1d1a16bd6064eedb63a67cd8a3bc83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:27.742747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.743491 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-be16c9c2-eb9c-492f-8adf-7cf06f1a0902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:27.745080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1350/2702] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:27 2022] DELETE /identity/v3/projects/a1d1a16bd6064eedb63a67cd8a3bc83b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:27.750156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.750451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.750731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.769968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:27.771215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.850157 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1353/2703] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:27.858722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.859083 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.859325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.880869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:27.882102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:27.891411 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1351/2704] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:27.895654 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:27.906017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ebe7e-e2a4-4a8f-a33e-6ec507ae9564 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:27.911548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:27.912198 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.912514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.913014 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.913736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:27.914044 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:27.915901 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:27.929132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1354/2705] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:27.934041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:27.944368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155baf76-4d94-494e-a79b-cd21fbb6223b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:27.950305 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:27.950983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:27.951295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:27.951616 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:27.952261 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:27.954178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:27.971938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:27.989825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1352/2706] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:27 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:27.994481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:28.007477 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c53a3-db7c-4db7-9d03-9a6510c86a3e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:28.084966 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:28.085538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.085816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.086090 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.086807 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:28.088787 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:28.114676 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1355/2707] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:27 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:28.119137 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:28.132721 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f3f78-3b3a-4c61-8d03-bbeaf64ba0b9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:28.138019 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:28.138795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.139097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.139375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.140191 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:28.141863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:28.153821 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1353/2708] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:28.159790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:28.171492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a416b-dac2-44a5-8b5d-420e0823bef4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:28.177407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:28.178083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.178365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.178633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.179403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:28.181017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd337c-8221-4b32-b0fc-a0b1218f6161 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:28.192523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1356/2709] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:28.198148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:28.209315 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98a00-c8b3-4867-9870-544aa1fc9d95 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:28.215024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:28.215898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.216181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.216455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] PATH_INFO: `/v3/projects/a16bdf2819fc48748068cf373a8f9c32/users/75c549ba65514d7abaf3a6f52cef3908/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.232775 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16bdf2819fc48748068cf373a8f9c32, user_id=75c549ba65514d7abaf3a6f52cef3908, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:28.235537 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:28.251733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1354/2710] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:28 2022] PUT /identity/v3/projects/a16bdf2819fc48748068cf373a8f9c32/users/75c549ba65514d7abaf3a6f52cef3908/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:28.257739 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4865d5-5b97-4cc4-b3d0-42d9a24e59c2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.258032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4865d5-5b97-4cc4-b3d0-42d9a24e59c2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.258317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4865d5-5b97-4cc4-b3d0-42d9a24e59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.277920 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-ba4865d5-5b97-4cc4-b3d0-42d9a24e59c2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:28.279201 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ba4865d5-5b97-4cc4-b3d0-42d9a24e59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:28.317404 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:28.345072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1357/2711] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:28.355635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:28.358523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:28.426486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dad03f-c5e8-4dcd-bf52-bb631f414377 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:28.430466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:28.431180 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:28.431469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:28.431786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:28.441963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:28.443462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:28.453811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1355/2712] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:32.715544 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:32.716129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:32.716129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:32.749801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] MFA Rules not processed for user `75c549ba65514d7abaf3a6f52cef3908`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:32.751068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:32.821825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1358/2713] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:32.826359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:32.836365 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9a9a-3f39-4d53-aac3-6a9743e338e5 service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:32.841324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:32.841994 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:32.842276 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:32.842581 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:32.843309 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:32.845225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:32.872780 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1356/2714] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:32 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:32.876868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:32.888623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87cde-a7e1-4a6a-b12f-f773b8b24bb6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:32.951392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:32.952100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:32.952385 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:32.952663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:32.953436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:32.955485 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:32.977084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1359/2715] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:32 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:32.981938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:32.993542 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851cb4d-968b-433e-9f26-8766484b9ceb admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:32.998351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:32.999075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:32.999362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:32.999643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:33.000388 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:33.002003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:33.013481 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1357/2716] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:33.017780 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:33.028464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851008-cbe1-4624-a640-9df50fc83078 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:33.033407 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:33.034308 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:33.034594 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:33.034871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] PATH_INFO: `/v3/projects/927d6571e06a4dd0a060cc67bffb0f85/users/6ddcf73c97064fa88663ded3cb0584fa/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:33.050236 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d6571e06a4dd0a060cc67bffb0f85, user_id=6ddcf73c97064fa88663ded3cb0584fa, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:33.053203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:33.070693 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1360/2717] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:33 2022] PUT /identity/v3/projects/927d6571e06a4dd0a060cc67bffb0f85/users/6ddcf73c97064fa88663ded3cb0584fa/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:33.072145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:33.083067 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e718432-f410-46b5-a5a5-b9675a5b30f9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:33.139186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:33.139853 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:33.140149 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:33.140421 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:33.141167 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:33.142794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:33.153206 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1358/2718] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:33.158423 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:33.170252 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2190-a730-4cbd-8809-216c61acd0f7 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:33.176670 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:33.177563 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:33.177850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:33.178221 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] PATH_INFO: `/v3/projects/927d6571e06a4dd0a060cc67bffb0f85/users/6ddcf73c97064fa88663ded3cb0584fa/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:33.181368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927d6571e06a4dd0a060cc67bffb0f85, user_id=6ddcf73c97064fa88663ded3cb0584fa, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:33.183095 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b194a2-ec6e-4dfb-872f-feb7636953e6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:33.194559 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1361/2719] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:33 2022] PUT /identity/v3/projects/927d6571e06a4dd0a060cc67bffb0f85/users/6ddcf73c97064fa88663ded3cb0584fa/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:35.720052 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:35.722002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:35.751548 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93360d2b-007b-4832-9497-688de8f08514 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:35.811146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:35.863953 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:35.865161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:35.865704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:35.866286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] PATH_INFO: `/v3/users/4e9edfeeed814f338561ad0bd0b986f4` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:35.868005 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9edfeeed814f338561ad0bd0b986f4)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:35.871135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:35.942091 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9edfeeed814f338561ad0bd0b986f4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:35.968752 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9edfeeed814f338561ad0bd0b986f4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:35.976645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9edfeeed814f338561ad0bd0b986f4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:35.988963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9edfeeed814f338561ad0bd0b986f4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:36.009014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9edfeeed814f338561ad0bd0b986f4'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:36.023617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1359/2720] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:35 2022] DELETE /identity/v3/users/4e9edfeeed814f338561ad0bd0b986f4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:36.026615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:36.027077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:36.027335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:36.060646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:36.062591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:36.089448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:36.158508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1362/2721] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:36.169842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:36.172366 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:36.360641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497eccf-3045-45fc-8208-9c4e9fe06971 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:36.365864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:36.366336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:36.366620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:36.366900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:36.391143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:36.394072 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975186fe-3f30-491a-a5d4-382c971ba728 service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:36.418260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1360/2722] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:37.103554 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:37.105949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:37.131277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feefe1-f63d-4684-9ad4-9b3be62c46ff None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:37.137616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:37.143335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:37.144013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:37.144660 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] PATH_INFO: `/v3/projects/b824d9ef4e29468189d2088e563997a1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:37.146338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b824d9ef4e29468189d2088e563997a1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:37.148968 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:37.220630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b824d9ef4e29468189d2088e563997a1', 'request_id': 'req-02fcb074-f8d7-4703-856e-c479f46d2f81'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:37.232494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b824d9ef4e29468189d2088e563997a1', 'request_id': 'req-02fcb074-f8d7-4703-856e-c479f46d2f81'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:37.250117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b824d9ef4e29468189d2088e563997a1', 'request_id': 'req-02fcb074-f8d7-4703-856e-c479f46d2f81'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:37.295633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] The token cache is being invalidate because project b824d9ef4e29468189d2088e563997a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:37.296214 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:37.297229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:37.311026 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1363/2723] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:37 2022] DELETE /identity/v3/projects/b824d9ef4e29468189d2088e563997a1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:38.524855 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:38.525343 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:38.525435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:38.576244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] MFA Rules not processed for user `6ddcf73c97064fa88663ded3cb0584fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:38.577611 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:38.625417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:38.669740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1361/2724] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:38.684035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:38.686372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:38.765200 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb074-f8d7-4703-856e-c479f46d2f81 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:38.770896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:38.771742 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:38.772110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:38.772394 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:38.774285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:38.818284 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:38.836356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:38.838001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4b0d6-1df8-4c7f-b0ee-11f197d47743 service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:38.847301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1364/2725] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:41.192298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:41.216729 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dd648-9ae5-432e-bfd8-b332fbb5d185 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:41.232630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:41.234717 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:41.240169 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:41.242712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:41.255507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:41.274082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:41.276497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:41.349266 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1362/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:41.548006 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:41.548491 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:41.548600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:41.589482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] MFA Rules not processed for user `75c549ba65514d7abaf3a6f52cef3908`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:41.591504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:41.620741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1365/2727] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:45.328341 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:45.329988 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:45.402731 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f035-9ffe-42f4-95c9-4e7e6412cea1 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:45.407234 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:45.407900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:45.408207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:45.408486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:45.410273 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:45.479501 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:45.480881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:45.491505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1363/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:48.935705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:48.937932 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:48.960017 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f968fd-1a91-45d7-9b7d-eae0c207b15d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:48.964806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:48.965668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:48.965980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:48.966248 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] PATH_INFO: `/v3/users/c26c047c73a748cda14345a2ca3aa319` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:48.967486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26c047c73a748cda14345a2ca3aa319)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:48.969390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.027399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26c047c73a748cda14345a2ca3aa319'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.028043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26c047c73a748cda14345a2ca3aa319'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.034849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26c047c73a748cda14345a2ca3aa319'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.035511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26c047c73a748cda14345a2ca3aa319'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.047074 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-51dd7140-6358-4100-b69e-75c7d5cf5e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26c047c73a748cda14345a2ca3aa319'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.063714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1366/2729] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:48:48 2022] DELETE /identity/v3/users/c26c047c73a748cda14345a2ca3aa319 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:49.246738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.258112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3392d9-bbf2-44fb-8f55-1177805ed4ab service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.317102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.317965 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.318287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.318620 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] PATH_INFO: `/v3/projects/c5e207ce011f4d27801b82f81c7c2162` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.319896 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e207ce011f4d27801b82f81c7c2162)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.321832 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.332681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:49.379772 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e207ce011f4d27801b82f81c7c2162', 'request_id': 'req-f850f7d6-4da1-4619-a0cc-ef02918a1172'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.385903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e207ce011f4d27801b82f81c7c2162', 'request_id': 'req-f850f7d6-4da1-4619-a0cc-ef02918a1172'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.392391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e207ce011f4d27801b82f81c7c2162', 'request_id': 'req-f850f7d6-4da1-4619-a0cc-ef02918a1172'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.408006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] The token cache is being invalidate because project c5e207ce011f4d27801b82f81c7c2162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:48:49.408300 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.409027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-f850f7d6-4da1-4619-a0cc-ef02918a1172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:48:49.410652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1364/2730] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:48:49 2022] DELETE /identity/v3/projects/c5e207ce011f4d27801b82f81c7c2162 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:48:49.415819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.416107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.416382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.435084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:49.436291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:49.509136 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1367/2731] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:49.517117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.517414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.517692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.538066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:49.539308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:49.549161 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1365/2732] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:49.553530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.564758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e218a87-fab2-41d4-a34f-b055edbd3a1a None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.571018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.571724 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.571979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.572256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.572963 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:48:49.573285 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.574950 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.591339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1368/2733] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:48:49.592523 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.603601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbef70-3f3d-4389-9193-ba9e35edb205 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.612582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.613272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.613552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.614530 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.615641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.617902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.649734 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1366/2734] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:48:49 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:48:49.661753 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.675164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ed0d-a0f6-4885-bb54-39649376f73f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.713858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:49.740123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.740846 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.741128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.741402 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.742084 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.744050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.767176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1369/2735] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:48:49 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:48:49.771699 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.782120 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13ae1-8bcf-4415-bb5e-bd951510cea9 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.787185 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.788026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.788314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.788588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.789320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.790940 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.801401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1367/2736] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:49.808615 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.823355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d318ec-cced-4a5c-a2a8-84ef0f2d6ebf admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.828199 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.828877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.829168 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.829445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.830177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.831849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad917c-fa94-4641-8560-81584389a42c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.843702 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1370/2737] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:48:49.848281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:49.859345 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903be421-1f26-4ef3-99e9-cc5b607566a4 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:49.865223 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:49.866245 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.866543 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.866818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] PATH_INFO: `/v3/projects/7f24ce5ca99244b0bd62705ed963825d/users/357a50dbd5624997b3a0d5344717f852/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.884150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f24ce5ca99244b0bd62705ed963825d, user_id=357a50dbd5624997b3a0d5344717f852, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:49.886977 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:49.902712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1368/2738] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:48:49 2022] PUT /identity/v3/projects/7f24ce5ca99244b0bd62705ed963825d/users/357a50dbd5624997b3a0d5344717f852/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:48:49.908382 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13042db-eaac-4f0b-95c6-8d5680a64fa2 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:49.908672 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13042db-eaac-4f0b-95c6-8d5680a64fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:49.908948 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13042db-eaac-4f0b-95c6-8d5680a64fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:49.929582 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b13042db-eaac-4f0b-95c6-8d5680a64fa2 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:49.930790 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b13042db-eaac-4f0b-95c6-8d5680a64fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:49.989842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1371/2739] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:48:50.000707 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:50.004441 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:50.066829 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327e2d1-cd34-48b7-ac87-2471c8f1adc8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:50.072213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:50.073113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:50.073499 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:50.073782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:50.087555 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:50.089678 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:50.103704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1369/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:53.853334 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:53.853824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:53.853908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:53.883316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] MFA Rules not processed for user `357a50dbd5624997b3a0d5344717f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:53.884716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:53.952926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1372/2741] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:53.968009 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:53.969639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:54.014335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:48:54.053205 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818968f4-ea72-451f-8057-54b52948661c service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:54.059810 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:54.060712 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:54.061000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:54.061289 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:54.070622 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:54.072559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665def9-4ed4-4ce2-a03b-50af98824492 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:54.083370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1370/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:55.431907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:55.433632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:55.447806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409b3df-5ea7-4a0a-ba6f-dfa6ea2214ac None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:55.451840 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:55.452518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:55.452810 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:55.453083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:55.455060 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:55.467990 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:55.469838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:55.480877 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1373/2743] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:48:56.019766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:56.020323 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:56.020867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:56.040103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] MFA Rules not processed for user `357a50dbd5624997b3a0d5344717f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:48:56.041264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:56.053394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1371/2744] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:48:56.420886 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:48:56.430340 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7ad7-fabb-407e-82f5-3c88531fef0f service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:48:56.451613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:48:56.452465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:48:56.452705 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:48:56.453326 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:48:56.458323 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:48:56.471618 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:48:56.473089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:48:56.482870 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1374/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:49:06.034186 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=19 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:49:06.309228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:49:06.323094 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49cc16-5bbb-4e16-8106-155f677f4eb8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:49:06.329482 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:49:06.330148 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:49:06.330429 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:49:06.330706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:49:06.332652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:49:06.346746 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:49:06.348392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:49:06.360053 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1372/2746] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:49:06.480310 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:49:10.926513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:49:10.936297 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2943a4-6594-40ad-ba33-10e47e67fd7e service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:49:10.940486 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:49:10.941149 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:49:10.941435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:49:10.941722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:49:10.943621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:49:11.025673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:49:11.027330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:49:11.037584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1375/2747] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:49:16.356096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=6 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:49:21.033015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=30 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:51:20.236468 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:51:20.238097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:51:20.386310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127ac75-64a3-4c64-9cc9-eb7e88395adb service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:51:20.392632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:51:20.393286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:51:20.393575 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:51:20.393852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:51:20.395822 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:51:20.407784 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:51:20.409350 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:51:20.419426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1373/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:51:21.314412 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:51:21.347370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0331a3-d4ba-4a32-b30c-a781c58bab9d service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:51:21.352002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:51:21.352320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:51:21.352798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:51:21.353077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:51:21.355712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:51:21.382449 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:51:21.384047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40b805-312a-43a1-9fa0-001373cb70ff service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:51:21.392645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1376/2749] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:51:21.471800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:51:21.481475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5eb4-9aab-4279-a5ee-d52eb77c1f22 service placement] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:51:21.485243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:51:21.485880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:51:21.486162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:51:21.486439 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:51:21.488271 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:51:21.521588 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:51:21.523059 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:51:21.544157 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1374/2750] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:51:30.245918 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31e0-5a83-470b-864f-15c87993353b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:51:30.246510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31e0-5a83-470b-864f-15c87993353b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:51:30.246510 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c31e0-5a83-470b-864f-15c87993353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:51:30.265418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-932c31e0-5a83-470b-864f-15c87993353b None None] MFA Rules not processed for user `357a50dbd5624997b3a0d5344717f852`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:51:30.266628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-932c31e0-5a83-470b-864f-15c87993353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:51:30.274484 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1377/2751] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:51:31.541296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=81 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:51:40.259330 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=23 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:19.991033 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:19.992943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:20.081568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e174-a346-4cb1-8b6a-3fa2d7d7a41c service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:20.086043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:20.086682 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:20.086961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:20.087253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:20.089162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:20.103447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:20.104882 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:20.116117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1375/2752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:23.001119 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c31e0-5a83-470b-864f-15c87993353b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:23.011704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c31e0-5a83-470b-864f-15c87993353b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:23.015508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:23.016169 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:23.016452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:23.016758 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:23.018874 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:23.034068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:23.035557 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:23.047167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1378/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:30.111312 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=35 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:33.041858 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=6 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:39.780878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:39.803210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280dbde-35ca-4ae5-bbea-3c3b4a56045c service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:39.809384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:39.810047 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:39.810335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:39.810613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:39.812495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:39.826288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:39.827960 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:39.840947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1376/2754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:39.844396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:39.889283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c0a23-8f3e-43a5-a4ce-e3c2e957f6af service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:39.894602 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:39.895589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:39.895876 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:39.896154 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] PATH_INFO: `/v3/users/357a50dbd5624997b3a0d5344717f852` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:39.897353 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357a50dbd5624997b3a0d5344717f852)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:39.899339 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:39.947926 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357a50dbd5624997b3a0d5344717f852'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:39.948627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357a50dbd5624997b3a0d5344717f852'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:39.955796 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357a50dbd5624997b3a0d5344717f852'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:39.956459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357a50dbd5624997b3a0d5344717f852'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:39.971173 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-9b374879-454d-42fb-94e7-6cced3fd3a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357a50dbd5624997b3a0d5344717f852'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:39.987380 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1379/2755] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:39 2022] DELETE /identity/v3/users/357a50dbd5624997b3a0d5344717f852 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:40.165287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.178814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deb41c-8621-42b1-b994-d7680c9b82da service placement] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.238132 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.238938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.239240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.239511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] PATH_INFO: `/v3/projects/7f24ce5ca99244b0bd62705ed963825d` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.240720 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f24ce5ca99244b0bd62705ed963825d)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.242665 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.300898 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f24ce5ca99244b0bd62705ed963825d', 'request_id': 'req-beea307d-6e64-4212-8062-80d7c55e27c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:40.306742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f24ce5ca99244b0bd62705ed963825d', 'request_id': 'req-beea307d-6e64-4212-8062-80d7c55e27c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:40.312959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f24ce5ca99244b0bd62705ed963825d', 'request_id': 'req-beea307d-6e64-4212-8062-80d7c55e27c0'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:40.338899 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] The token cache is being invalidate because project 7f24ce5ca99244b0bd62705ed963825d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:40.339216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:40.339841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-beea307d-6e64-4212-8062-80d7c55e27c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:40.341702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1377/2756] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:40 2022] DELETE /identity/v3/projects/7f24ce5ca99244b0bd62705ed963825d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:40.347740 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.348071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.348515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.421434 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:40.422706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:40.492908 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1380/2757] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:40.500949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.501279 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.501384 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.520692 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:40.521900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:40.530433 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1378/2758] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:52:40.534983 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.545166 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68655d7a-4e99-494c-ab31-3af36bff78b6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.551370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.552016 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.552312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.552580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.553808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:52:40.553808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.555545 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.573542 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1381/2759] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:52:40.575227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.586693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39371c-d09b-4dfe-966e-d5e3767cb3d0 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.592425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.593117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.593395 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.593664 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.594353 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.596762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.637404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1379/2760] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:40 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:40.642277 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.652967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2852-cca7-4b6e-b621-374aeeea1411 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.663467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:40.714057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.714730 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.715039 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.715322 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.716327 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.718263 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.740360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1382/2761] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:40 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:40.744624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.755446 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac23b4-1461-44d8-8c97-692da5298611 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.760992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.761658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.761944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.762219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.762982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.764603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.775134 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1380/2762] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:40.779237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.789935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda031d-2f6d-412a-8ebe-5bcd739e9df0 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.794902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.795581 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.795867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.796167 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.796891 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.799120 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad98ab3-88e6-4129-8aeb-5fe0260227ad admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.809351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1383/2763] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:40.813683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.824200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc2cc-a690-45f3-8076-321d88553b45 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:40.829568 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:40.830447 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.830733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.831044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] PATH_INFO: `/v3/projects/adfa8592bc51485ea6a086dce745a613/users/b2fe7d53c30941e0b4c303bbe2fab3f1/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.849046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfa8592bc51485ea6a086dce745a613, user_id=b2fe7d53c30941e0b4c303bbe2fab3f1, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:40.853409 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:40.856786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:40.874791 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1381/2764] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:40 2022] PUT /identity/v3/projects/adfa8592bc51485ea6a086dce745a613/users/b2fe7d53c30941e0b4c303bbe2fab3f1/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:40.885333 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:40.885834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:40.885956 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:40.913659 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] MFA Rules not processed for user `b2fe7d53c30941e0b4c303bbe2fab3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:40.914860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:40.979958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1384/2765] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:40.991648 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:40.993818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:41.069379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c10e70-f2c3-4f60-ac09-684ef9e0713f admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:41.077055 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:41.077695 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:41.077970 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:41.078239 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:41.087213 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:41.088800 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b461-268b-44ad-83a5-cd3ce5d1feb1 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:41.098814 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1382/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:43.816068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:43.881556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c07c1-3ab9-4fe5-8941-029d755f3bd3 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:43.886716 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:43.887616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:43.887885 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:43.888186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] PATH_INFO: `/v3/users/b2fe7d53c30941e0b4c303bbe2fab3f1` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:43.889415 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fe7d53c30941e0b4c303bbe2fab3f1)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:43.891435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:43.915414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:43.944695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fe7d53c30941e0b4c303bbe2fab3f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:43.945376 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fe7d53c30941e0b4c303bbe2fab3f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:43.952631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fe7d53c30941e0b4c303bbe2fab3f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:43.953304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fe7d53c30941e0b4c303bbe2fab3f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:43.967225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fe7d53c30941e0b4c303bbe2fab3f1'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:43.982009 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1385/2767] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:43 2022] DELETE /identity/v3/users/b2fe7d53c30941e0b4c303bbe2fab3f1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:43.987455 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:43.988017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:43.988017 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.007765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:44.009109 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:44.070182 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1383/2768] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:44.080520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:44.081946 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:44.143429 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1fcf1-79f3-4ad8-a2e1-cc7147843eb9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:44.147375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:44.148033 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.148315 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.148598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.161083 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:44.162570 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a0d6f-ec5e-4a9d-9af6-35e98f26b668 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:44.172467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1386/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:44.687768 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:44.689576 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:44.701919 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4d8a-2a24-4aa1-96ad-f9a371daac34 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:44.707457 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:44.708324 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.708598 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.708870 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] PATH_INFO: `/v3/projects/adfa8592bc51485ea6a086dce745a613` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.710174 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfa8592bc51485ea6a086dce745a613)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:44.712117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:44.763966 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfa8592bc51485ea6a086dce745a613', 'request_id': 'req-6d40de0d-248c-4973-874b-5862fb42f655'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:44.769979 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfa8592bc51485ea6a086dce745a613', 'request_id': 'req-6d40de0d-248c-4973-874b-5862fb42f655'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:44.776277 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfa8592bc51485ea6a086dce745a613', 'request_id': 'req-6d40de0d-248c-4973-874b-5862fb42f655'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:44.789010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] The token cache is being invalidate because project adfa8592bc51485ea6a086dce745a613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:44.789321 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:44.789931 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-6d40de0d-248c-4973-874b-5862fb42f655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:44.791541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1384/2770] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:44 2022] DELETE /identity/v3/projects/adfa8592bc51485ea6a086dce745a613 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:44.796636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.796873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.797152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.817952 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:44.819192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:44.883177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1387/2771] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:44.893118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.893551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.893750 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.901242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:44.915639 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:44.917473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:44.926163 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1385/2772] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:44.930766 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:44.941036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b3dd4-7ed2-42f5-9e60-018b49f4c4e6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:44.946137 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:44.946808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.947133 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.947408 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.948141 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:52:44.948451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:44.950058 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:44.962379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1388/2773] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:52:44.966890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:44.976351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a262e-0a5e-49df-aa7b-40e68df37d9c None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:44.981428 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:44.982076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:44.982361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:44.982635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:44.983352 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:44.985331 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.015007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1386/2774] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:44 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:45.018662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.029410 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f991c-052d-477a-982b-814e42fe98fa admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.060127 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:45.093464 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.094130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.094450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.094737 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.095459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.097390 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.118835 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1389/2775] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:45 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:45.123073 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.133539 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac06-619b-4cff-a162-8c129a7ceba8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.138475 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.139168 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.139454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.139739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.140451 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.142147 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.152880 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1387/2776] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:45.157002 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.168985 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace234-f8fd-41f9-838a-4ed2768ecb8f admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.174686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.175381 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.175663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.175934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.178321 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.180015 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733eef5-6189-4d06-b569-fb65012faec7 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.190590 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1390/2777] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:45.195075 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.205473 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ccf6-0c03-4508-ab49-0ae8e63b327e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.210311 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531c31-6941-413c-a853-d570f431877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.211222 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531c31-6941-413c-a853-d570f431877d admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.212097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531c31-6941-413c-a853-d570f431877d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.212379 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531c31-6941-413c-a853-d570f431877d admin admin] PATH_INFO: `/v3/projects/408bb71836314a7cbb2937d31e9c96b8/users/2b524e353a3441f2942c5370d0672f10/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.227529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531c31-6941-413c-a853-d570f431877d admin admin] RBAC: Authorizing `identity:create_grant(project_id=408bb71836314a7cbb2937d31e9c96b8, user_id=2b524e353a3441f2942c5370d0672f10, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.230173 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531c31-6941-413c-a853-d570f431877d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.244900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1388/2778] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:45 2022] PUT /identity/v3/projects/408bb71836314a7cbb2937d31e9c96b8/users/2b524e353a3441f2942c5370d0672f10/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:45.255800 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.256089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.256372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.283580 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] MFA Rules not processed for user `2b524e353a3441f2942c5370d0672f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:45.284838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:45.348929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1391/2779] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:45.353691 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531c31-6941-413c-a853-d570f431877d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.416333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531c31-6941-413c-a853-d570f431877d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.422106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.423199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.423199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.423467 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.424122 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.426070 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.454758 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1389/2780] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:45 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:45.459313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.471440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3340f8-a426-48b7-82ab-d072c9f53531 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.537383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.538316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.538683 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.539102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.540144 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.543251 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.573312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1392/2781] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:45 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:45.577545 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.588702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55b192-0e00-478c-8b83-99a6b7652a26 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.593983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.595046 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.595449 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.595893 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.596614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.598215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.608776 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1390/2782] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:45.612893 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.622931 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1db1f2-d9e4-40ca-9085-c1f1a27caa64 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.628195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.629072 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.629338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.629609 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] PATH_INFO: `/v3/projects/b1ce99101b704bb681e5bd64ba98f51d/users/cd630bcfa5a542aa9849b895825a15d8/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.644844 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ce99101b704bb681e5bd64ba98f51d, user_id=cd630bcfa5a542aa9849b895825a15d8, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.647525 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.663490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1393/2783] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:45 2022] PUT /identity/v3/projects/b1ce99101b704bb681e5bd64ba98f51d/users/cd630bcfa5a542aa9849b895825a15d8/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:45.667495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.678051 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cd58-06b4-48e3-a6e4-8f30b4945f2b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.736435 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.737102 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.737392 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.737667 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.738393 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.740024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adc47-b27e-4043-9a38-b178897b82e3 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.750215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1391/2784] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:45.756628 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.764630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:45.769107 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b8cf-af26-47da-a027-69fa8ade4c5d admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.775855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.776754 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.777038 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.777317 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] PATH_INFO: `/v3/projects/b1ce99101b704bb681e5bd64ba98f51d/users/cd630bcfa5a542aa9849b895825a15d8/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.779627 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ce99101b704bb681e5bd64ba98f51d, user_id=cd630bcfa5a542aa9849b895825a15d8, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:45.782354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:45.793661 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1394/2785] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:45 2022] PUT /identity/v3/projects/b1ce99101b704bb681e5bd64ba98f51d/users/cd630bcfa5a542aa9849b895825a15d8/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:45.804058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.804351 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.804661 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:45.823401 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:45.833359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] MFA Rules not processed for user `cd630bcfa5a542aa9849b895825a15d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:45.834566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:45.910427 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1392/2786] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:45.924492 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:45.926417 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:45.984999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c550f-2127-4f4f-b1a7-f7c621bc9f46 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:45.991999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:45.993012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:45.993436 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:45.993784 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:46.007027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:46.008470 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:46.018428 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1395/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:46.100930 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:46.111112 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4952c16-519e-432b-8018-2ed239fa2414 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:46.114732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:46.115405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:46.115688 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:46.115962 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:46.180155 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:46.181506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:46.190883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1393/2788] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:48.624274 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:48.626741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:48.695650 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11315-99d2-44b8-bd1a-3133e1ebb4bc service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:48.700007 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:48.700679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:48.700958 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:48.701230 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:48.703253 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:48.712848 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:48.714281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2643-92eb-49ca-89c3-b6f2a7b6192a service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:48.722673 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1396/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:53.198143 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:53.265850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67c3cd-2875-489d-8dab-2872275c5ec4 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:53.271125 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:53.272037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:53.272404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:53.272848 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] PATH_INFO: `/v3/users/2b524e353a3441f2942c5370d0672f10` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:53.274195 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b524e353a3441f2942c5370d0672f10)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:53.276208 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:53.317938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:53.329827 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b524e353a3441f2942c5370d0672f10'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:53.348443 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b524e353a3441f2942c5370d0672f10'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:53.349417 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b524e353a3441f2942c5370d0672f10'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:53.363275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b524e353a3441f2942c5370d0672f10'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:53.372698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b524e353a3441f2942c5370d0672f10'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:53.380008 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1394/2790] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:53 2022] DELETE /identity/v3/users/2b524e353a3441f2942c5370d0672f10 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:53.384489 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:53.384964 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:53.385057 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:53.405933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:53.407411 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:53.473454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1397/2791] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:53.483058 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:53.484597 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:53.549546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7593f38-1f72-4f58-8d32-d0118ad0b2ac admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:53.553159 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:53.553815 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:53.554093 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:53.554364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:53.563546 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:53.565281 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:53.574992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1395/2792] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:54.028857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:54.031032 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:54.050630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50838e33-929b-4d7d-86fe-9f756f79a954 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:54.056041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:54.057176 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:54.057526 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:54.057863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] PATH_INFO: `/v3/projects/408bb71836314a7cbb2937d31e9c96b8` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:54.059346 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408bb71836314a7cbb2937d31e9c96b8)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:54.061472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:54.111777 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:54.128986 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408bb71836314a7cbb2937d31e9c96b8', 'request_id': 'req-55b79bf7-8e84-4a49-8610-ebbbbf60f765'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.154596 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408bb71836314a7cbb2937d31e9c96b8', 'request_id': 'req-55b79bf7-8e84-4a49-8610-ebbbbf60f765'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.174561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408bb71836314a7cbb2937d31e9c96b8', 'request_id': 'req-55b79bf7-8e84-4a49-8610-ebbbbf60f765'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.194392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] The token cache is being invalidate because project 408bb71836314a7cbb2937d31e9c96b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:54.194692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.195585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.197761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1398/2793] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:54 2022] DELETE /identity/v3/projects/408bb71836314a7cbb2937d31e9c96b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:54.201733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:54.214485 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543c10-a09e-4b49-a7b3-a3f592b288cc service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:54.286624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:54.287706 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:54.288200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:54.288649 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] PATH_INFO: `/v3/users/cd630bcfa5a542aa9849b895825a15d8` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:54.290498 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd630bcfa5a542aa9849b895825a15d8)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:54.293901 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:54.367420 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd630bcfa5a542aa9849b895825a15d8'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.375920 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:54.383133 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd630bcfa5a542aa9849b895825a15d8'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.383493 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd630bcfa5a542aa9849b895825a15d8'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.395544 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd630bcfa5a542aa9849b895825a15d8'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.409015 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-e99787fa-0752-4daf-a83a-202ed64c2158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd630bcfa5a542aa9849b895825a15d8'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:54.416367 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1396/2794] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:54 2022] DELETE /identity/v3/users/cd630bcfa5a542aa9849b895825a15d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:54.909379 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:54.911102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:54.926880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79bf7-8e84-4a49-8610-ebbbbf60f765 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:54.988446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:54.989351 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:54.989635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:54.989912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] PATH_INFO: `/v3/projects/b1ce99101b704bb681e5bd64ba98f51d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:54.991242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ce99101b704bb681e5bd64ba98f51d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:54.993189 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.044335 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ce99101b704bb681e5bd64ba98f51d', 'request_id': 'req-ab50debf-30af-4828-b938-58566b839f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:55.054122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ce99101b704bb681e5bd64ba98f51d', 'request_id': 'req-ab50debf-30af-4828-b938-58566b839f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:55.059865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ce99101b704bb681e5bd64ba98f51d', 'request_id': 'req-ab50debf-30af-4828-b938-58566b839f43'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:55.070972 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] The token cache is being invalidate because project b1ce99101b704bb681e5bd64ba98f51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:55.071265 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:55.071935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-ab50debf-30af-4828-b938-58566b839f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:55.073508 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1399/2795] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:54 2022] DELETE /identity/v3/projects/b1ce99101b704bb681e5bd64ba98f51d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:55.078733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579173-2354-4df1-b145-85e995362ea8 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.079550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579173-2354-4df1-b145-85e995362ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.079550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579173-2354-4df1-b145-85e995362ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.101335 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-78579173-2354-4df1-b145-85e995362ea8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:55.102725 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-78579173-2354-4df1-b145-85e995362ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:55.164659 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1397/2796] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:52:55.172816 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.173203 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.173595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.193403 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:55.194748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:55.203269 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1400/2797] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:55.208103 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579173-2354-4df1-b145-85e995362ea8 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.218847 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579173-2354-4df1-b145-85e995362ea8 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.223984 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.224773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.225152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.225438 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.226194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80494) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:52:55.226507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.228181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.241242 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1398/2798] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:52:55.245892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.256903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab174e-65f6-44ad-a610-210fe58fb00b None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.262179 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.262951 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.263397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.263679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.264362 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.266369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.299268 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1401/2799] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:52:55.300662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.311538 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f40dcf-aa3d-4f93-a5d4-3732730e2c54 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.374506 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.375211 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.375479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.375762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.376452 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.378370 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.400869 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1399/2800] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:55.405047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.416052 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f083-5129-4a88-934b-724c326efd40 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.420575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.421313 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.421595 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.421871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.422762 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.424518 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.435515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1402/2801] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:55.440152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.454254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25379-598b-4f3a-8aa6-17209a0d8999 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.459879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.460554 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.460836 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.461111 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.461844 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.463549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88da79c-534e-4227-a909-2f1a44887d73 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.474834 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1400/2802] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:55.479123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.490349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e21d6d-7f0e-4bc5-b10c-2727a6450b96 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.495677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.496565 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.496843 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.497117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] PATH_INFO: `/v3/projects/5ad6ebdc18814575979535c6fb0d107d/users/7c713c4a78904d0393cb917d86ad881d/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.505461 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:55.513598 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad6ebdc18814575979535c6fb0d107d, user_id=7c713c4a78904d0393cb917d86ad881d, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.517283 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.532706 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1403/2803] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:55 2022] PUT /identity/v3/projects/5ad6ebdc18814575979535c6fb0d107d/users/7c713c4a78904d0393cb917d86ad881d/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:55.543744 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.544117 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.544456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.574803 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] MFA Rules not processed for user `7c713c4a78904d0393cb917d86ad881d`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:55.576166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:55.609258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:55.649595 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1401/2804] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:55.654372 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.728153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb653279-fc78-4200-b898-6443d19ba736 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.733125 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.733898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.734276 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.734662 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.735591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.737643 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.769320 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1404/2805] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:55.773503 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.786850 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392196f4-fa51-40b6-9c18-974a677d809f None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.869162 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.870462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.870760 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.871076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] PATH_INFO: `/v3/users` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.871792 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.873773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.901116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1402/2806] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:55 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:55.905462 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.918222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeff2c5-7a6b-4493-8930-2c18d300ff3e admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.930223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.931418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.931827 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.932316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.933316 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.936278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:55.953040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1405/2807] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:55.954992 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:55.967590 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351412-5163-426d-a351-af8e3a57b525 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:55.973935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:55.974942 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:55.975313 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:55.975660 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] PATH_INFO: `/v3/projects/64a902129c544a66a2dffcf31252cf24/users/3b01070b911e4adcbfebc30d0c2c6b78/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:55.992945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a902129c544a66a2dffcf31252cf24, user_id=3b01070b911e4adcbfebc30d0c2c6b78, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:55.995676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:56.018650 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1403/2808] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:55 2022] PUT /identity/v3/projects/64a902129c544a66a2dffcf31252cf24/users/3b01070b911e4adcbfebc30d0c2c6b78/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:56.022825 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:56.034513 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476ae20-c8d4-4643-bee0-b02f6f228e61 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:56.109059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:56.109744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:56.110262 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:56.110821 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:56.111142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:56.112842 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b821f-a251-4e23-9058-d4c07f244c8f admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:56.123047 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1406/2809] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:52:56.127407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:56.137878 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1fd8-97b1-410b-a222-c39097e083e0 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:56.142613 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:56.143604 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:56.143831 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:56.144107 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] PATH_INFO: `/v3/projects/64a902129c544a66a2dffcf31252cf24/users/3b01070b911e4adcbfebc30d0c2c6b78/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:56.146240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a902129c544a66a2dffcf31252cf24, user_id=3b01070b911e4adcbfebc30d0c2c6b78, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:56.149013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:56.160000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1404/2810] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:56 2022] PUT /identity/v3/projects/64a902129c544a66a2dffcf31252cf24/users/3b01070b911e4adcbfebc30d0c2c6b78/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:56.171514 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:56.171804 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:56.172082 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:56.200142 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] MFA Rules not processed for user `3b01070b911e4adcbfebc30d0c2c6b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:56.202043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:56.251606 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:56.277786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1407/2811] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:56.289463 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:56.291264 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:56.350937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d66ab-1e36-4756-8be6-5ba725edfe1d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:56.354989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:56.355635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:56.355911 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:56.356181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:56.365943 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:56.367404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:56.389624 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1405/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:52:57.946668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.032232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e460-81b1-41a8-8936-e46d221ccd75 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.037077 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.038049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.038386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.038943 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] PATH_INFO: `/v3/users/7c713c4a78904d0393cb917d86ad881d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.040365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c713c4a78904d0393cb917d86ad881d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.043050 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.124225 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c713c4a78904d0393cb917d86ad881d'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.124896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c713c4a78904d0393cb917d86ad881d'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.139684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c713c4a78904d0393cb917d86ad881d'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.141453 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c713c4a78904d0393cb917d86ad881d'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.169995 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-4a80d4c1-35b9-4574-b70e-b748d8157efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c713c4a78904d0393cb917d86ad881d'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.186495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.188243 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.189059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1408/2813] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:57 2022] DELETE /identity/v3/users/7c713c4a78904d0393cb917d86ad881d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:58.193355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.193646 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.193922 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.208156 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa585-c1b3-4608-a122-a0c7ce25727e service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.214233 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:58.215855 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.229207 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:58.268641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.269514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.269788 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.270084 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] PATH_INFO: `/v3/users/75c549ba65514d7abaf3a6f52cef3908` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.271310 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c549ba65514d7abaf3a6f52cef3908)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.273210 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.275418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1409/2814] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:52:58.285882 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.287249 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.292589 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:58.327408 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c549ba65514d7abaf3a6f52cef3908'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.339916 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c549ba65514d7abaf3a6f52cef3908'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.340929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c549ba65514d7abaf3a6f52cef3908'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.348232 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c549ba65514d7abaf3a6f52cef3908'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.351227 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75099569-ee93-4f1b-a6c6-4598a5445518 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.355745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.356443 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.356722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c549ba65514d7abaf3a6f52cef3908'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.356850 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.357012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.363013 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.367065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1406/2815] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:58 2022] DELETE /identity/v3/users/75c549ba65514d7abaf3a6f52cef3908 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:58.371575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.373098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.383165 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1410/2816] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 20:52:58.585442 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.587027 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.682036 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226327-3f6d-4c8b-86cb-59654dd88023 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.686932 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.687840 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.688431 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.688753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] PATH_INFO: `/v3/projects/a16bdf2819fc48748068cf373a8f9c32` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.690066 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16bdf2819fc48748068cf373a8f9c32)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.691983 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.697164 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.699062 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.720805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b23ee-8ae2-45a6-8826-945bc0bd2d0d service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.726561 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.727482 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.727768 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.728132 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] PATH_INFO: `/v3/projects/5ad6ebdc18814575979535c6fb0d107d` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.729387 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad6ebdc18814575979535c6fb0d107d)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.731511 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.742582 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:58.746486 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16bdf2819fc48748068cf373a8f9c32', 'request_id': 'req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.753630 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16bdf2819fc48748068cf373a8f9c32', 'request_id': 'req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.761382 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16bdf2819fc48748068cf373a8f9c32', 'request_id': 'req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.774480 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] The token cache is being invalidate because project a16bdf2819fc48748068cf373a8f9c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:58.774771 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.775490 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.777297 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1407/2817] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:58 2022] DELETE /identity/v3/projects/a16bdf2819fc48748068cf373a8f9c32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:58.780921 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.781100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad6ebdc18814575979535c6fb0d107d', 'request_id': 'req-1e01f991-280e-40cf-baf2-12916a351368'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.783065 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.789245 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad6ebdc18814575979535c6fb0d107d', 'request_id': 'req-1e01f991-280e-40cf-baf2-12916a351368'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.795424 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad6ebdc18814575979535c6fb0d107d', 'request_id': 'req-1e01f991-280e-40cf-baf2-12916a351368'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.808108 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] The token cache is being invalidate because project 5ad6ebdc18814575979535c6fb0d107d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:58.808331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.808979 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.810531 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1411/2818] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:58 2022] DELETE /identity/v3/projects/5ad6ebdc18814575979535c6fb0d107d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:58.814612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:58.815988 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:58.852641 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ab25-3a62-4d80-b86c-7c03ae4aa12e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.883515 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f991-280e-40cf-baf2-12916a351368 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:58.888583 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.889459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.889744 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.890018 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] PATH_INFO: `/v3/users/3b01070b911e4adcbfebc30d0c2c6b78` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.891358 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b01070b911e4adcbfebc30d0c2c6b78)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.893275 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.909240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:58.910099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:58.910376 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:58.910644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] PATH_INFO: `/v3/users/6ddcf73c97064fa88663ded3cb0584fa` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:58.911874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddcf73c97064fa88663ded3cb0584fa)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:58.913782 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:58.926745 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:58.943684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b01070b911e4adcbfebc30d0c2c6b78'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.944817 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b01070b911e4adcbfebc30d0c2c6b78'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.954292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b01070b911e4adcbfebc30d0c2c6b78'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.955027 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b01070b911e4adcbfebc30d0c2c6b78'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.962240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddcf73c97064fa88663ded3cb0584fa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.968303 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b01070b911e4adcbfebc30d0c2c6b78'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.974804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddcf73c97064fa88663ded3cb0584fa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.975881 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddcf73c97064fa88663ded3cb0584fa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.981311 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1412/2819] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:58 2022] DELETE /identity/v3/users/3b01070b911e4adcbfebc30d0c2c6b78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:58.982820 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddcf73c97064fa88663ded3cb0584fa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.991466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddcf73c97064fa88663ded3cb0584fa'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:58.994080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:58.999749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1408/2820] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:52:58 2022] DELETE /identity/v3/users/6ddcf73c97064fa88663ded3cb0584fa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:59.213156 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.214731 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:59.287309 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cef8f-2e7a-4188-b09f-caba60ff119a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.297559 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.300018 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:59.362355 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.363150 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.363432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.363707 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] PATH_INFO: `/v3/projects/927d6571e06a4dd0a060cc67bffb0f85` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.364959 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927d6571e06a4dd0a060cc67bffb0f85)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.366869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.373519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50855c-54eb-4a8d-848c-7e7f85a289fe admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.378860 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.379755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.380037 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.380316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] PATH_INFO: `/v3/projects/64a902129c544a66a2dffcf31252cf24` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.381519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a902129c544a66a2dffcf31252cf24)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.383469 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.414161 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927d6571e06a4dd0a060cc67bffb0f85', 'request_id': 'req-d93be70d-bd18-4868-819e-1c0c0590d950'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.421913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927d6571e06a4dd0a060cc67bffb0f85', 'request_id': 'req-d93be70d-bd18-4868-819e-1c0c0590d950'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.423452 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:52:59.428546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927d6571e06a4dd0a060cc67bffb0f85', 'request_id': 'req-d93be70d-bd18-4868-819e-1c0c0590d950'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.432875 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a902129c544a66a2dffcf31252cf24', 'request_id': 'req-fa78a7e3-4d86-4a74-9fbe-4728ac608751'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.438773 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a902129c544a66a2dffcf31252cf24', 'request_id': 'req-fa78a7e3-4d86-4a74-9fbe-4728ac608751'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.441115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] The token cache is being invalidate because project 927d6571e06a4dd0a060cc67bffb0f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:59.441301 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.441940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-d93be70d-bd18-4868-819e-1c0c0590d950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.443775 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1413/2821] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:59 2022] DELETE /identity/v3/projects/927d6571e06a4dd0a060cc67bffb0f85 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:59.445658 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a902129c544a66a2dffcf31252cf24', 'request_id': 'req-fa78a7e3-4d86-4a74-9fbe-4728ac608751'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.461096 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] The token cache is being invalidate because project 64a902129c544a66a2dffcf31252cf24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:52:59.461673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.462436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-fa78a7e3-4d86-4a74-9fbe-4728ac608751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:52:59.464166 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1409/2822] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:52:59 2022] DELETE /identity/v3/projects/64a902129c544a66a2dffcf31252cf24 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:52:59.469913 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.470188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.470447 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.491755 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:59.493087 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:59.562059 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1414/2823] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:59.570369 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.570656 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.570941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.590418 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:52:59.592013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:52:59.601139 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1410/2824] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:52:59.605831 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.616826 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db8951-7b1a-4aba-912e-047c84b644a6 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.621929 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.622608 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.622896 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.623215 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.623961 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:52:59.624289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.626093 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.639916 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1415/2825] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:52:59.644572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.658841 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e48cd-5ebb-4b6c-b1cf-901922f971a3 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.664852 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.665549 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.665801 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.666158 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.667179 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.669045 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.700826 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1411/2826] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:52:59 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:59.705907 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.717035 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486810-d6d0-4cda-a776-1e269affa6e6 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.773529 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.774193 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.774481 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.774761 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.775478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.777409 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.802045 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1416/2827] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:52:59 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:52:59.806849 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.822516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b59a9-2dee-43b8-a897-e8655981120e admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.830088 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.831106 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.831516 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.831897 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.833030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.835171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.850765 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1412/2828] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:59.856798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.869012 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e673b5-1b51-4be8-a7bc-9ddc4a6e1a22 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.874819 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.875578 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.875818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.876202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.876940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.878610 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedfcbe-4c67-4724-9f01-ed194767218c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.889130 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1417/2829] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:52:59.893811 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:52:59.910858 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2917b1-8da5-4807-938c-a2453d6f138b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:52:59.920807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:52:59.922236 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.922933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.923233 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] PATH_INFO: `/v3/projects/a8e44b8fb25d4074921efd5459e7b8cd/users/2ac5f85be30141e3986e6788d3263efc/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:52:59.940564 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e44b8fb25d4074921efd5459e7b8cd, user_id=2ac5f85be30141e3986e6788d3263efc, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:52:59.943280 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:52:59.963287 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1413/2830] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:52:59 2022] PUT /identity/v3/projects/a8e44b8fb25d4074921efd5459e7b8cd/users/2ac5f85be30141e3986e6788d3263efc/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:52:59.974250 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:52:59.974779 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:52:59.974880 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.004864 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] MFA Rules not processed for user `2ac5f85be30141e3986e6788d3263efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:00.006102 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:00.047747 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:00.086413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1418/2831] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:00.091454 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.122809 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:00.164248 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7200f-4bea-493d-8176-6e65d8855dea admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.169362 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.170026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.170308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.170584 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.171296 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.173197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.204807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1414/2832] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:53:00 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 20:53:00.206065 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.220081 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ce551-eb5e-4e3d-a827-fbf43deb992d None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.283621 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.284312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.284600 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.284911 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.285612 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.287686 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.311597 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1419/2833] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:53:00 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:00.316522 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.327515 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6fddf-c5c1-4c95-9b2e-00d5244ff510 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.332863 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.333614 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.333963 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.334299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.335150 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.336825 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.348997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1415/2834] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:00.355614 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.371448 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c9a28-94a9-421b-9eb3-1fa067428c35 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.378365 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.379222 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.379505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.379782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] PATH_INFO: `/v3/projects/974e4bbed805494dbce9fb9769951e3f/users/824510cbd2154e46bdeb608fbdf5ce88/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.394712 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=974e4bbed805494dbce9fb9769951e3f, user_id=824510cbd2154e46bdeb608fbdf5ce88, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.397446 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.412162 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1420/2835] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:00 2022] PUT /identity/v3/projects/974e4bbed805494dbce9fb9769951e3f/users/824510cbd2154e46bdeb608fbdf5ce88/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:00.418225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.434846 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483776-3a2e-48c2-97af-eff3ce18a6f8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.512057 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.512724 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.513254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.513531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.514260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.515876 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b641-cdd4-45c7-829a-c9cc737f3647 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.525941 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1416/2836] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:00.530363 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.542884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cec82-bd5d-4421-bdbe-b450cda75875 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.549616 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.550604 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.550892 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.551208 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] PATH_INFO: `/v3/projects/974e4bbed805494dbce9fb9769951e3f/users/824510cbd2154e46bdeb608fbdf5ce88/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.553967 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=974e4bbed805494dbce9fb9769951e3f, user_id=824510cbd2154e46bdeb608fbdf5ce88, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.556536 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.572456 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1421/2837] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:00 2022] PUT /identity/v3/projects/974e4bbed805494dbce9fb9769951e3f/users/824510cbd2154e46bdeb608fbdf5ce88/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:00.639868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.640077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.640325 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.673883 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] MFA Rules not processed for user `824510cbd2154e46bdeb608fbdf5ce88`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:00.675152 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:00.749929 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1417/2838] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:00.761682 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:00.763636 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:00.824782 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea0fc2-f431-49b5-9717-8c615bfa0122 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:00.829463 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:00.830100 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:00.830386 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:00.830664 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:00.878367 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:00.892808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:00.894258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:00.903223 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1422/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:02.276951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:02.278573 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:02.291337 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d037c-8412-4abc-aadb-1d2177f02fdf None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:02.295437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:02.296078 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:02.296357 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:02.296632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:02.306617 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:02.308089 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5481b70-aac8-491f-b80f-8b7b5a48f7c4 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:02.318737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1418/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:06.135677 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:06.204987 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8705-96b3-47d4-bfd2-c7d681142c37 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:06.209928 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:06.210794 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:06.211094 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:06.211375 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] PATH_INFO: `/v3/users/2ac5f85be30141e3986e6788d3263efc` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:06.212584 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac5f85be30141e3986e6788d3263efc)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:06.214505 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:06.263153 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac5f85be30141e3986e6788d3263efc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.263812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac5f85be30141e3986e6788d3263efc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.272421 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac5f85be30141e3986e6788d3263efc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.273086 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac5f85be30141e3986e6788d3263efc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.289684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac5f85be30141e3986e6788d3263efc'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.312935 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1423/2841] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:53:06 2022] DELETE /identity/v3/users/2ac5f85be30141e3986e6788d3263efc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:06.318200 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:06.318738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:06.318738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:06.338971 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:06.340101 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:06.344879 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:06.410450 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1419/2842] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:53:06.420299 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:06.421890 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:06.484523 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f44ac-4db0-4236-9db7-11b7901efc3a admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:06.490435 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:06.491368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:06.491653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:06.491999 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:06.507852 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:06.510049 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:06.522640 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1424/2843] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:06.808937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:06.810531 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:06.824013 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ece9b-20f8-4027-b908-1cfeae280851 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:06.830489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:06.831437 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:06.831749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:06.832225 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] PATH_INFO: `/v3/projects/a8e44b8fb25d4074921efd5459e7b8cd` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:06.833407 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e44b8fb25d4074921efd5459e7b8cd)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:06.835569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:06.885976 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e44b8fb25d4074921efd5459e7b8cd', 'request_id': 'req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.891697 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e44b8fb25d4074921efd5459e7b8cd', 'request_id': 'req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.898254 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e44b8fb25d4074921efd5459e7b8cd', 'request_id': 'req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.913925 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] The token cache is being invalidate because project a8e44b8fb25d4074921efd5459e7b8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:53:06.914215 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.914874 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:06.916492 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1420/2844] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:53:06 2022] DELETE /identity/v3/projects/a8e44b8fb25d4074921efd5459e7b8cd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:06.920651 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:06.930572 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa0f5-9ec5-4a50-8a94-7487f1a15ecb service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:06.935556 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:06.994459 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:06.995366 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:06.995645 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:06.995905 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] PATH_INFO: `/v3/users/824510cbd2154e46bdeb608fbdf5ce88` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:06.997188 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] RBAC: Authorizing `identity:delete_user(user_id=824510cbd2154e46bdeb608fbdf5ce88)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:06.999185 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.048115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824510cbd2154e46bdeb608fbdf5ce88'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.048803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824510cbd2154e46bdeb608fbdf5ce88'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.056217 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824510cbd2154e46bdeb608fbdf5ce88'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.056861 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824510cbd2154e46bdeb608fbdf5ce88'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.069497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-44fc9214-ce55-45d2-b02c-6eadfa94743e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824510cbd2154e46bdeb608fbdf5ce88'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.084934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1425/2845] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:53:06 2022] DELETE /identity/v3/users/824510cbd2154e46bdeb608fbdf5ce88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:07.378907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.380495 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:07.394890 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9437ff7-2d79-4ff1-8ca1-d1800c1f5558 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.455843 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.456710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.456989 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.457255 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] PATH_INFO: `/v3/projects/974e4bbed805494dbce9fb9769951e3f` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.458465 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974e4bbed805494dbce9fb9769951e3f)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.460404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.499740 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:07.512947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974e4bbed805494dbce9fb9769951e3f', 'request_id': 'req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.518748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974e4bbed805494dbce9fb9769951e3f', 'request_id': 'req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.525010 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974e4bbed805494dbce9fb9769951e3f', 'request_id': 'req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.540007 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] The token cache is being invalidate because project 974e4bbed805494dbce9fb9769951e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:53:07.540295 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.540986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-cf55b22b-5816-4ad1-83a9-7edaf0e1ca95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:07.542518 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1421/2846] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:53:07 2022] DELETE /identity/v3/projects/974e4bbed805494dbce9fb9769951e3f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:07.547497 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.548146 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.548254 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.566579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:07.567836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:07.637111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1426/2847] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:07.649873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.650190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.650583 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.674494 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:07.676375 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:07.691298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1422/2848] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:07.695873 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.706663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b966c7-2494-4269-b8cb-ea9aa40c7130 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.712371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.713031 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.713314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.713591 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.714350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:53:07.714656 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.716679 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.729043 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1427/2849] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:53:07.733602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.743813 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb628e-e35e-4e04-a6f3-55702cc14fa4 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.749316 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.750006 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.750290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.750566 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.751519 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.753472 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.782817 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1423/2850] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:53:07 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:07.786839 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.796857 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2c6e-6081-49f2-84e2-97bd8911c4e9 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.810369 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:07.860273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.860941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.861257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.861538 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.862669 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.864641 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.887834 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1428/2851] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:53:07 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:07.892032 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.902632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9956a2d-69d9-494b-88e4-10f265ce23c1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.907933 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.908636 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.908944 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.909218 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.910030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.911805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.923513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1424/2852] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:07.927613 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.938025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44982ef4-64f3-46cc-9299-5fb4885de7c1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.944695 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.945350 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.945635 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.945912 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.946630 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:07.948255 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc23bd1-5fa6-4d30-9754-866dd569ab3c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:07.958789 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1429/2853] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 20:53:07.963043 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:07.974238 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319028-5f64-4c9d-ae75-7f0a3a1bff6d admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:07.979705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:07.980646 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:07.980928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:07.981204 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] PATH_INFO: `/v3/projects/d35d26411bb44d21a99c71d6e1e34019/users/165e4dfcd1e444de81244a1937b974a3/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:07.997694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35d26411bb44d21a99c71d6e1e34019, user_id=165e4dfcd1e444de81244a1937b974a3, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.000440 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.019553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1425/2854] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:07 2022] PUT /identity/v3/projects/d35d26411bb44d21a99c71d6e1e34019/users/165e4dfcd1e444de81244a1937b974a3/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:53:08.030036 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.030331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.030655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.058980 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] MFA Rules not processed for user `165e4dfcd1e444de81244a1937b974a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:08.060202 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:08.127011 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1430/2855] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:53:08.131748 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.194314 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9a83-7170-493f-a8b1-b972109701b1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.199732 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.200402 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.200684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.200957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.201684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.203645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.231824 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1426/2856] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:53:08 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:08.236029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.246760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0196f30-b42c-4a04-aa11-2ab259a5a1db None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.314281 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.315025 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.315312 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.315585 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.316258 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.318360 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.340121 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1431/2857] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:53:08 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:08.344570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.355244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086144c7-fe64-4fe1-b228-64f0db2cdea7 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.361044 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.361635 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.362014 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.362294 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.363064 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.364683 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.376645 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1427/2858] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:08.381278 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.395806 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131a930-c5f0-4d1d-88a3-bf2bfcd09772 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.403418 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.404338 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.404619 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.404895 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] PATH_INFO: `/v3/projects/3446a5c91b5f47fb877984c050729430/users/64598539cec14795ad70649bbdc8ce17/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.417838 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:08.422824 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3446a5c91b5f47fb877984c050729430, user_id=64598539cec14795ad70649bbdc8ce17, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.430111 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.447388 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1432/2859] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:08 2022] PUT /identity/v3/projects/3446a5c91b5f47fb877984c050729430/users/64598539cec14795ad70649bbdc8ce17/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:08.451507 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.461749 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa55aad-1037-4505-abbe-a3b282b1948b admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.495755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:08.527913 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.528586 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.528864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.529135 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.529864 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.531510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c07ae-6c1e-4275-bcd6-cb9dbde93bbe admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.541828 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1428/2860] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:08.546331 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.557300 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830d8c1-0779-4450-8945-a523829e3eb4 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.562663 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.563639 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.563944 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.564370 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] PATH_INFO: `/v3/projects/3446a5c91b5f47fb877984c050729430/users/64598539cec14795ad70649bbdc8ce17/roles/8674ca022dbe4b239eb4b83af2de25b7` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.566633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3446a5c91b5f47fb877984c050729430, user_id=64598539cec14795ad70649bbdc8ce17, role_id=8674ca022dbe4b239eb4b83af2de25b7)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.569289 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.580940 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1433/2861] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:08 2022] PUT /identity/v3/projects/3446a5c91b5f47fb877984c050729430/users/64598539cec14795ad70649bbdc8ce17/roles/8674ca022dbe4b239eb4b83af2de25b7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 20:53:08.593336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.593644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.593917 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.622456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] MFA Rules not processed for user `64598539cec14795ad70649bbdc8ce17`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:08.623747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:08.697505 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1429/2862] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 20:53:08.710451 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.712555 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:08.773392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429b836-9ece-4140-a346-795a93da81e1 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.777808 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.778450 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.778741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.779042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.790055 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.791558 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:08.802158 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1434/2863] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:08.905755 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:08.916502 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05b17-e03f-4f01-8e27-93d66a8f373b None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:08.920594 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:08.921244 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:08.921526 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:08.921799 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:08.991246 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:08.992633 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff36e-0632-4cee-8879-22785135f561 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:09.001985 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1430/2864] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:13.927345 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:13.996085 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db18b3-c0c8-427e-b807-e0c0e6756325 service cinder] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:14.000903 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:14.001836 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:14.002123 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:14.002397 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] PATH_INFO: `/v3/users/165e4dfcd1e444de81244a1937b974a3` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:14.003633 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=165e4dfcd1e444de81244a1937b974a3)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:14.005623 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:14.057949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165e4dfcd1e444de81244a1937b974a3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.058798 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165e4dfcd1e444de81244a1937b974a3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.066478 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165e4dfcd1e444de81244a1937b974a3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.067239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165e4dfcd1e444de81244a1937b974a3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.080029 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165e4dfcd1e444de81244a1937b974a3'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.089504 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:14.095992 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1435/2865] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:53:13 2022] DELETE /identity/v3/users/165e4dfcd1e444de81244a1937b974a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:14.100900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:14.101414 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:14.101533 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:14.120284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:14.121551 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:14.168739 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=100 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:14.182700 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1431/2866] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:14.192849 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:14.194295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:14.253439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec324e4-ebbc-4e39-95a7-07ebbdeb8bfc admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:14.257396 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:14.258070 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:14.258354 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:14.258631 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:14.267853 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:14.269291 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:14.278934 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1436/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:14.566753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:14.568299 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:14.580484 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0be86-928a-46e5-b738-0577f104b850 None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:14.585873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:14.586785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:14.587116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:14.587373 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] PATH_INFO: `/v3/projects/d35d26411bb44d21a99c71d6e1e34019` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:14.588733 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35d26411bb44d21a99c71d6e1e34019)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:14.591031 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:14.638900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35d26411bb44d21a99c71d6e1e34019', 'request_id': 'req-b6413b39-7b65-405f-8c51-b711a8f95841'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.644676 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35d26411bb44d21a99c71d6e1e34019', 'request_id': 'req-b6413b39-7b65-405f-8c51-b711a8f95841'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.650955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35d26411bb44d21a99c71d6e1e34019', 'request_id': 'req-b6413b39-7b65-405f-8c51-b711a8f95841'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.665425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] The token cache is being invalidate because project d35d26411bb44d21a99c71d6e1e34019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:53:14.665718 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.666358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.667927 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1432/2868] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:53:14 2022] DELETE /identity/v3/projects/d35d26411bb44d21a99c71d6e1e34019 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:14.672257 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:14.682493 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26c584-23d7-4487-b6dd-c0fa18846418 service neutron] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:14.743292 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:14.744175 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:14.744460 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:14.744736 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] PATH_INFO: `/v3/users/64598539cec14795ad70649bbdc8ce17` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:14.745933 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64598539cec14795ad70649bbdc8ce17)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:14.747960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:14.800106 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64598539cec14795ad70649bbdc8ce17'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.800812 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64598539cec14795ad70649bbdc8ce17'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.808466 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64598539cec14795ad70649bbdc8ce17'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.809098 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64598539cec14795ad70649bbdc8ce17'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.823568 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-2dd9219a-0c9d-463d-bcc0-b13d7a3e9a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64598539cec14795ad70649bbdc8ce17'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:14.838467 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1437/2869] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:53:14 2022] DELETE /identity/v3/users/64598539cec14795ad70649bbdc8ce17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:15.116082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.117652 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:15.131528 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6413b39-7b65-405f-8c51-b711a8f95841 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.192115 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.192909 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.193190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.193466 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] PATH_INFO: `/v3/projects/3446a5c91b5f47fb877984c050729430` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.194737 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3446a5c91b5f47fb877984c050729430)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.196722 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.252675 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3446a5c91b5f47fb877984c050729430', 'request_id': 'req-5141131b-4ea8-435f-9bba-e6c3703c8e7f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:15.258380 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3446a5c91b5f47fb877984c050729430', 'request_id': 'req-5141131b-4ea8-435f-9bba-e6c3703c8e7f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:15.265171 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3446a5c91b5f47fb877984c050729430', 'request_id': 'req-5141131b-4ea8-435f-9bba-e6c3703c8e7f'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:15.279900 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] The token cache is being invalidate because project 3446a5c91b5f47fb877984c050729430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80494) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:53:15.280275 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:15.281024 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-5141131b-4ea8-435f-9bba-e6c3703c8e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:53:15.282861 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1433/2870] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:53:15 2022] DELETE /identity/v3/projects/3446a5c91b5f47fb877984c050729430 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:15.288426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.288915 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.289061 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.309868 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:15.311318 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:15.326655 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:15.383509 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1438/2871] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:15.392762 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.393056 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.393333 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.407404 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:15.414358 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:15.416681 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:15.425954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1434/2872] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:15.430548 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.441974 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdbb53-cc2b-409c-b4e0-ec4d15c86015 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.447195 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.447786 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.448071 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.448349 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.449117 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80495) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 20:53:15.449426 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.451067 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.464797 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1439/2873] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 13 20:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 20:53:15.469705 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.479794 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3e9fa-951f-4fdd-bdda-bb58ec456f8e None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.486026 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.486687 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.487003 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.487282 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] PATH_INFO: `/v3/projects` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.487975 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.489982 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.520436 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1435/2874] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 13 20:53:15 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:15.524863 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.536040 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6818ce3-ab7a-45c2-ba05-dc1b5bb4c698 admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.603068 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.603811 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.604219 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.604576 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] PATH_INFO: `/v3/users` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.605432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.607898 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.635041 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1440/2875] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 13 20:53:15 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 20:53:15.640077 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.652410 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf13d5-4e20-425a-b02e-077343eda73a admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.657902 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.658580 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.658868 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.659190 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.659959 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.661684 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.672812 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1436/2876] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:15.677042 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.687465 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e576e-d664-4f9d-baae-1b787a18bfea admin admin] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.692652 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.693304 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.693586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.693818 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.694566 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.696192 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a46aa-91f5-479d-80ac-8bb52af4ff63 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.706232 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1441/2877] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 13 20:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 20:53:15.710947 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.721795 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45e2e-4811-4bcd-8870-1074d0150fc8 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.727807 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.728698 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.728978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.729253 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] PATH_INFO: `/v3/projects/85756b404cc54b24bef94e6740199d47/users/544fa4d8b82e47fda5568a4569bd5fcf/roles/ad923c69cc724dfd804ae86198b268c0` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.744478 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85756b404cc54b24bef94e6740199d47, user_id=544fa4d8b82e47fda5568a4569bd5fcf, role_id=ad923c69cc724dfd804ae86198b268c0)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.747164 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.761701 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1437/2878] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 13 20:53:15 2022] PUT /identity/v3/projects/85756b404cc54b24bef94e6740199d47/users/544fa4d8b82e47fda5568a4569bd5fcf/roles/ad923c69cc724dfd804ae86198b268c0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:53:15.767128 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ac-24a1-46ef-85e6-a420e0ec84c3 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.767445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ac-24a1-46ef-85e6-a420e0ec84c3 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.767721 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c188ac-24a1-46ef-85e6-a420e0ec84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.786875 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-e4c188ac-24a1-46ef-85e6-a420e0ec84c3 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:15.788122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-e4c188ac-24a1-46ef-85e6-a420e0ec84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:15.852977 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1442/2879] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:15.864644 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:15.866552 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:15.933290 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a6ac-4661-429c-92e5-77b72fa6c6a2 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:15.937425 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:15.938082 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:15.938368 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:15.938643 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:15.948517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:15.949951 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:15.959753 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1438/2880] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:16.642229 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a420-5c8d-40ad-8909-9d905f78d3e8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:16.642760 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a420-5c8d-40ad-8909-9d905f78d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:16.642879 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a420-5c8d-40ad-8909-9d905f78d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:16.675668 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c568a420-5c8d-40ad-8909-9d905f78d3e8 None None] MFA Rules not processed for user `544fa4d8b82e47fda5568a4569bd5fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:16.676949 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c568a420-5c8d-40ad-8909-9d905f78d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:16.691237 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:16.746688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1443/2881] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:16.757626 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:16.759121 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:16.820623 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238304f0-c282-4564-be28-a667f0e02d8a service neutron] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:16.824303 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d33da4251e47d8a330ef0e84ee0fdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:16.824955 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:16.825240 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:16.825514 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:16.835336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:16.836786 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:16.850456 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1439/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:18.234680 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3faae-41e0-4c5b-bd2c-6445aac01214 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:18.235242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3faae-41e0-4c5b-bd2c-6445aac01214 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:18.235473 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3faae-41e0-4c5b-bd2c-6445aac01214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:18.256089 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-43d3faae-41e0-4c5b-bd2c-6445aac01214 None None] MFA Rules not processed for user `544fa4d8b82e47fda5568a4569bd5fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:18.257445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-43d3faae-41e0-4c5b-bd2c-6445aac01214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:18.266256 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1444/2883] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:18.890145 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:18.892020 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:18.953030 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:18.975945 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949f0b0-a6d5-4eb1-8889-36aecd985e71 service cinder] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:18.981779 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:18.982550 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:18.982892 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:18.983288 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:18.985462 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:18.999062 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:19.000647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:19.011403 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1440/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:28.249586 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=23 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:29.007220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=10 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:53:43.528483 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d101c-b30c-4370-97e5-2f9e24cfe760 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:43.529159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d101c-b30c-4370-97e5-2f9e24cfe760 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:43.529159 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d101c-b30c-4370-97e5-2f9e24cfe760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:43.551722 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-d87d101c-b30c-4370-97e5-2f9e24cfe760 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:43.552941 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-d87d101c-b30c-4370-97e5-2f9e24cfe760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:43.562867 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1445/2885] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:43.580398 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:43.582114 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:43.656647 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe16-6f6f-422e-80b7-3d0004b386d7 service placement] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:43.662602 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:43.663272 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:43.663547 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:43.663818 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:43.672910 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:43.674497 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:43.684328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1441/2886] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:46.574186 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5569-b221-4aee-83a5-2f65232b47b7 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:46.574770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5569-b221-4aee-83a5-2f65232b47b7 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:46.574770 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5569-b221-4aee-83a5-2f65232b47b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:46.594247 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-5d7d5569-b221-4aee-83a5-2f65232b47b7 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:46.595490 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-5d7d5569-b221-4aee-83a5-2f65232b47b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:46.604869 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1446/2887] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:46.620123 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:46.621804 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:46.638146 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad92008-0223-44f8-be6d-e0808ec0fcd7 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:46.644742 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:46.645378 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:46.645662 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:46.645937 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:46.655129 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:46.656823 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:46.666938 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1442/2888] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:49.859748 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe7b1-590b-4e90-bea5-b49b213a39e8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:49.860290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe7b1-590b-4e90-bea5-b49b213a39e8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:49.860290 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe7b1-590b-4e90-bea5-b49b213a39e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:49.878632 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6a0fe7b1-590b-4e90-bea5-b49b213a39e8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:49.879871 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6a0fe7b1-590b-4e90-bea5-b49b213a39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:49.888713 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1447/2889] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:49.904320 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:49.916160 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548645a-735f-42ab-97a7-287f00b2fcfd service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:49.923284 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:49.923954 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:49.924227 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:49.924500 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:49.933525 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:49.935364 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:49.945336 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1443/2890] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:55.038273 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc203-b615-4ae2-9dd4-4baad2dedef8 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:55.038803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc203-b615-4ae2-9dd4-4baad2dedef8 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:55.038803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc203-b615-4ae2-9dd4-4baad2dedef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:55.058241 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-c66dc203-b615-4ae2-9dd4-4baad2dedef8 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:55.059547 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-c66dc203-b615-4ae2-9dd4-4baad2dedef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:55.070937 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1448/2891] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:55.097359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:55.109092 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21021b5-0288-422e-a3cb-0490eafb77f0 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:55.115040 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:55.115668 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:55.115949 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:55.116228 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:55.124603 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:55.126178 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:55.135873 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1444/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:53:58.220694 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd588d1-0cb5-4f1f-ae8f-da02dc805e3e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:58.221239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd588d1-0cb5-4f1f-ae8f-da02dc805e3e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:58.221239 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd588d1-0cb5-4f1f-ae8f-da02dc805e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:58.240440 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-bdd588d1-0cb5-4f1f-ae8f-da02dc805e3e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:53:58.241649 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-bdd588d1-0cb5-4f1f-ae8f-da02dc805e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:53:58.250860 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1449/2893] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:53:58.272673 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:53:58.284710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327e14-1b40-4fbd-9539-0b54bd431761 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:53:58.291099 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:53:58.291781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:53:58.292116 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:53:58.292426 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:53:58.301570 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:53:58.303216 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:53:58.312967 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1445/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:01.411773 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571142f-103b-4855-8eab-123f4d08969e None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:01.412295 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571142f-103b-4855-8eab-123f4d08969e None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:01.412406 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571142f-103b-4855-8eab-123f4d08969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:01.432653 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-2571142f-103b-4855-8eab-123f4d08969e None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:01.433960 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-2571142f-103b-4855-8eab-123f4d08969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:01.443267 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1450/2895] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:01.460328 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:01.473757 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3a43-22e2-41d1-8776-c083d2255c69 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:01.479430 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:01.480080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:01.480359 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:01.480632 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:01.491197 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:01.493618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d02a63-565b-4fb7-9714-5d3c5371f795 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:01.512479 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1446/2896] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:10.949524 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571142f-103b-4855-8eab-123f4d08969e None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:10.957704 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=19 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:54:10.967495 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571142f-103b-4855-8eab-123f4d08969e None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:10.973475 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:10.974170 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:10.974457 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:10.974801 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:10.976788 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:10.989865 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:10.991546 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:11.003115 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1451/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:11.504076 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=64 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:54:15.726572 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] REQUEST_METHOD: `POST` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:15.727241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:15.727241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:15.746704 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.auth.core [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] MFA Rules not processed for user `544fa4d8b82e47fda5568a4569bd5fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80494) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:15.747957 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:15.755805 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1447/2898] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 13 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:15.995480 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:15.998122 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:16.013445 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087687ff-1da4-457a-b5ed-cf546793196f service nova] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:16.018356 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455761927d084f3893b404776f8dd9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:16.019147 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:16.019414 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:16.019692 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:16.021847 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:16.033113 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:16.034644 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ad2b5-2dc8-4992-a1de-b02128d623cb service neutron] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:16.043371 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1452/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:24.208541 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:24.224002 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e49cf-0c3c-447d-a05c-123261987c9d None None] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:24.229856 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:24.230513 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:24.230808 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:24.231118 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:24.232928 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:24.246214 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:24.247867 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:24.260080 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1448/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:26.039575 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=11 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:54:28.532152 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a87c3-6251-43f1-b073-99a662191928 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:28.532805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a87c3-6251-43f1-b073-99a662191928 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:28.532805 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a87c3-6251-43f1-b073-99a662191928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:28.551823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-3b8a87c3-6251-43f1-b073-99a662191928 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:28.553324 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-3b8a87c3-6251-43f1-b073-99a662191928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:28.562756 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1453/2901] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:28.580219 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:28.593260 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325be90-3b0e-4f44-bcaa-2280b5c76788 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:28.600842 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:28.601489 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:28.601766 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:28.602041 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:28.610961 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:28.612601 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:28.625361 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1449/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:31.802272 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791b2be-0d60-43d6-b110-0b9b228a8529 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:31.802769 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791b2be-0d60-43d6-b110-0b9b228a8529 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:31.802884 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791b2be-0d60-43d6-b110-0b9b228a8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:31.822522 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-a791b2be-0d60-43d6-b110-0b9b228a8529 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:31.823803 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-a791b2be-0d60-43d6-b110-0b9b228a8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:31.832579 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1454/2903] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:31.847990 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:31.860097 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77122-1bbe-4c91-9736-b0edf2ebb12f service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:31.867308 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:31.867877 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:31.868177 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:31.868444 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:31.877292 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:31.878866 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:31.889095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1450/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:34.902110 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fb5a-64ed-4edd-b7ad-93691c26a3e9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:34.902605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fb5a-64ed-4edd-b7ad-93691c26a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:34.902605 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746fb5a-64ed-4edd-b7ad-93691c26a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:34.921955 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6746fb5a-64ed-4edd-b7ad-93691c26a3e9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:34.923116 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6746fb5a-64ed-4edd-b7ad-93691c26a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:34.933494 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1455/2905] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:34.952230 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:34.964220 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa160531-cea3-4456-a851-45b23a3fca6f service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:34.971563 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:34.972194 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:34.972476 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:34.972738 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:34.981569 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:34.983184 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:34.993061 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1451/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:38.092314 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc6936-b6bf-42a1-bc0a-ae2c98ba14da None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:38.092862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc6936-b6bf-42a1-bc0a-ae2c98ba14da None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:38.092862 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc6936-b6bf-42a1-bc0a-ae2c98ba14da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:38.112998 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-62fc6936-b6bf-42a1-bc0a-ae2c98ba14da None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:38.114209 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-62fc6936-b6bf-42a1-bc0a-ae2c98ba14da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:38.124420 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1456/2907] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:38.140903 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:38.152702 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b083-476f-40c0-abc4-9e2271e40822 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:38.158524 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:38.159199 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:38.159510 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:38.159785 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:38.168095 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:38.169798 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:38.179405 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1452/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:41.272688 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] REQUEST_METHOD: `POST` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:41.273211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:41.273211 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:41.292439 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.auth.core [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] MFA Rules not processed for user `09add49e7af745969dc73cde82e7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80495) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 20:54:41.293657 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:54:41.303432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1457/2909] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jul 13 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 20:54:41.325907 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:54:41.337986 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6cbc7-4420-4a73-ad97-ffd3f4bd6c49 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:54:41.344391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eebb29015984c98a0c6867dcb03fd71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:54:41.345000 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:54:41.345286 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:54:41.345529 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:54:41.354113 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:54:41.355756 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:54:41.365669 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1453/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:54:51.286902 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=15 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:54:51.361517 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=39 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:55:09.319001 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:55:09.331097 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104795a-614d-4ffa-b8e2-1191c4538eb9 None None] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:55:09.337177 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:55:09.337823 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] REQUEST_METHOD: `GET` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:55:09.338101 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:55:09.338368 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:55:09.340383 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.fernet_utils [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80495) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:55:09.352856 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:55:09.354472 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:55:09.365714 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1458/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:55:09.382339 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:55:09.393127 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34438d-5532-4d26-89a0-be713a189f71 service nova] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:55:09.399710 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:55:09.400412 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:55:09.400693 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:55:09.400978 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] PATH_INFO: `/v3/users/544fa4d8b82e47fda5568a4569bd5fcf` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:55:09.402618 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544fa4d8b82e47fda5568a4569bd5fcf)` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:55:09.404553 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:55:09.456258 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544fa4d8b82e47fda5568a4569bd5fcf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.469104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544fa4d8b82e47fda5568a4569bd5fcf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.469781 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544fa4d8b82e47fda5568a4569bd5fcf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.476391 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544fa4d8b82e47fda5568a4569bd5fcf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.484298 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.notifications [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544fa4d8b82e47fda5568a4569bd5fcf'} {{(pid=80494) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.490241 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1454/2912] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 13 20:55:09 2022] DELETE /identity/v3/users/544fa4d8b82e47fda5568a4569bd5fcf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:55:09.674520 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] Authenticating user token {{(pid=80495) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:55:09.691129 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132db5e2-997b-413e-95dd-7a368eff6670 service placement] Validating token access rules against request {{(pid=80495) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:55:09.749530 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09add49e7af745969dc73cde82e7f5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b2e1869a6a84cb5949adf32c69b433a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80495) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:55:09.750399 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:55:09.750684 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:55:09.751063 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] PATH_INFO: `/v3/projects/85756b404cc54b24bef94e6740199d47` {{(pid=80495) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:55:09.752242 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85756b404cc54b24bef94e6740199d47)` {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:55:09.754171 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] RBAC: Authorization granted {{(pid=80495) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:55:09.804413 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85756b404cc54b24bef94e6740199d47', 'request_id': 'req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.814512 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85756b404cc54b24bef94e6740199d47', 'request_id': 'req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.820259 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85756b404cc54b24bef94e6740199d47', 'request_id': 'req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4'} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.831454 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] The token cache is being invalidate because project 85756b404cc54b24bef94e6740199d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80495) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 20:55:09.831741 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.832392 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG keystone.notifications [None req-b477c077-2746-4fdc-a28f-8cb31fbbc5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80495) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 20:55:09.833969 dv-cinder-849690-1-smb devstack@keystone.service[80495]: [pid: 80495|app: 0|req: 1459/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 13 20:55:09 2022] DELETE /identity/v3/projects/85756b404cc54b24bef94e6740199d47 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 20:55:19.487104 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:55:19.828432 dv-cinder-849690-1-smb devstack@keystone.service[80495]: DEBUG dbcounter [-] [80495] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 20:56:26.680694 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Authenticating user token {{(pid=80494) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 20:56:26.682394 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:56:26.758181 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3660b-003d-4f3a-a6d8-328dec529ab1 admin admin] Validating token access rules against request {{(pid=80494) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 20:56:26.820511 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85fda246a5de4acca67f975bd17f8139', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82d6f6afc9fd41369ce79f8fea8540e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80494) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 20:56:26.821172 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] REQUEST_METHOD: `GET` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 20:56:26.821432 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 20:56:26.821723 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80494) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 20:56:26.823747 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.fernet_utils [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80494) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 20:56:26.835935 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 20:56:26.837608 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae67eb-3ac0-412b-9664-fb0516c735e4 service placement] RBAC: Authorization granted {{(pid=80494) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 20:56:26.848074 dv-cinder-849690-1-smb devstack@keystone.service[80494]: [pid: 80494|app: 0|req: 1455/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 13 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 20:56:36.843997 dv-cinder-849690-1-smb devstack@keystone.service[80494]: DEBUG dbcounter [-] [80494] Writing DB stats keystone:SELECT=58 {{(pid=80494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}